hudi icon indicating copy to clipboard operation
hudi copied to clipboard

Published 20 hours ago • verified publisher icon apache

[WIP][HUDI-4690][HUDI-4503][Stacked on 6550] Cleaning up Hudi custom Spark `Rule`s

Open alexeykudinkin opened this issue 3 years ago • 1 comments

Change Logs

This PR cleans up considerable amount of Spark's (internal) resolution logic that has been copied over into Hudi components, while in reality there's no actual need for that.

Changelog: TBA

Issues this will be addressing:

  • HUDI-4503
  • HUDI-4690
  • HUDI-4872
  • HUDI-4861

Impact

None

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

alexeykudinkin avatar Aug 10 '22 23:08 alexeykudinkin

CI report:

  • 87bc657865114568f5e9bdc1009f25caaea2ede3 Azure: FAILURE
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Aug 22 '22 21:08 hudi-bot

CI report:

  • a3f8cab6db30b8186e19c3c3ac1c85c0fe3fa63f Azure: FAILURE
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Jan 08 '23 01:01 hudi-bot

CI is green:

Screenshot 2023-01-08 at 8 07 53 PM https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=14167&view=results

alexeykudinkin avatar Jan 09 '23 04:01 alexeykudinkin

Closing this in favor of rebased & squashed #7871

alexeykudinkin avatar Feb 06 '23 20:02 alexeykudinkin