hudi icon indicating copy to clipboard operation
hudi copied to clipboard

[HUDI-7825]Support Report pending clustering and compaction plan metric

Open LXin96 opened this issue 1 year ago • 1 comments

Change Logs

1、when just async clustering or async compaction schedule enable, and

clustering.async.enabled or compaction.async.enabled set false, then the flink job will not add clusterPlanOperator or CompactionPlanOperator

2、 but the pending plan metric emit in clusterPlanOperator or CompactionPlanOperator

3、so maybe support emit pending plan metric in StreamWriteOperatorCoordinator

Impact

Describe any public API or user-facing feature change or any performance impact.

Risk level (write none, low medium or high below)

If medium or high, explain what verification was done to mitigate the risks.

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change. If not, put "none".

  • The config description must be updated if new configs are added or the default value of the configs are changed
  • Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the ticket number here and follow the instruction to make changes to the website.

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

LXin96 avatar Jun 01 '24 10:06 LXin96

CI report:

  • bf9c593893ac89d14be23870cb2cfdbf28fffb84 UNKNOWN
  • cd538e19aca3e0e54142a7dca199ebc1fb4ced99 Azure: SUCCESS
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Jun 29 '24 15:06 hudi-bot