hive icon indicating copy to clipboard operation
hive copied to clipboard

HIVE-24167: TPC-DS query 14 fails while generating plan for the filter

Open okumin opened this issue 1 year ago • 2 comments

What changes were proposed in this pull request?

With this change, Hive skips using or persisting runtime stats when PlanMapper throws equivalence mapping violation.

In some more contexts, we've tried to resolve the violation in #5037 and #5077. However, we couldn't find an obvious way to ideally avoid the issue, which means a modification will likely cause another problem. That's why we are currently biased toward the current approach.

https://issues.apache.org/jira/browse/HIVE-24167

Why are the changes needed?

When this issue occurs, the query always fails. We think the disadvantage of failure is not well balanced with the advantage of fast failure. A query might run with a bit poorer performance without runtime stats, but it is not critical in most cases. That's why we would try disabling runtime stats in this case.

Does this PR introduce any user-facing change?

In the new behavior, affected queries will not fail but run without runtime statistics.

Is the change a dependency upgrade?

No.

How was this patch tested?

qtests.

okumin avatar Sep 17 '24 10:09 okumin

@zabetak Updated. Thanks for reviewing this PR and giving many suggestions. I believe the change is much simpler

okumin avatar Nov 05 '24 13:11 okumin

I rebased it again because the previous base revision was affected by HIVE-28611

okumin avatar Nov 07 '24 12:11 okumin

Thanks. Let me pick up the first option.

Ensure that the Pull Request has a +1 vote, and that 24 hours have elapsed since the first +1 vote was cast on the Pull Request. Note that this rule appears in the Hive Bylaws. Do not ignore it.

Based on this rule, I will wait for 1 day and return here.

okumin avatar Nov 14 '24 14:11 okumin