spark icon indicating copy to clipboard operation
spark copied to clipboard

[SPARK-50033] Add a hint to logical.Aggregate() node

Open agubichev opened this issue 1 year ago • 3 comments

What changes were proposed in this pull request?

Adds an abstract hint to the case class of Aggregate().

Why are the changes needed?

Ability to provide hints to Aggregate (up to follow-up PRs to define them)

Does this PR introduce any user-facing change?

No

How was this patch tested?

N/A

Was this patch authored or co-authored using generative AI tooling?

No

agubichev avatar Oct 17 '24 17:10 agubichev

@cloud-fan

agubichev avatar Oct 17 '24 19:10 agubichev

Mind filing a JIRA please?

HyukjinKwon avatar Oct 18 '24 01:10 HyukjinKwon

Mind filing a JIRA please?

Done in SPARK-50033

agubichev avatar Oct 18 '24 17:10 agubichev

The pyspark failure is unrelated, thanks, merging to master!

cloud-fan avatar Nov 01 '24 16:11 cloud-fan