[SPARK-44953][CORE] Log a warning when shuffle tracking is enabled along side another DA supported mechanism
What changes were proposed in this pull request?
Log a warning when shuffle tracking is enabled along side another DA supported mechanism
Why are the changes needed?
Some users enable both shuffle tracking and another mechanism (like migration) and then are confused when their jobs don't scale down.
https://issues.apache.org/jira/browse/SPARK-44953
Does this PR introduce any user-facing change?
Yes, user can find the warning log when enabled both shuffle tracking and another DA supported mechanism(shuffle decommission).
How was this patch tested?
No
Was this patch authored or co-authored using generative AI tooling?
NO
Hi @holdenk, could you please take a review this?
LGTM
It's been awhile (that's completely my fault) can you rebase and push and assuming CI still passes we can merge.
Thanks for your review @holdenk, rebased this PR.
Merged to current branch