hudi icon indicating copy to clipboard operation
hudi copied to clipboard

[MINOR] Add UT org.apache.hudi.io.TestHoodieTimelineArchiver#testRetryArchivalAfterPreviousFailedDeletion

Open kbuci opened this issue 1 year ago • 1 comments

Change Logs

  • Add unit test org.apache.hudi.io.TestHoodieTimelineArchiver#testRetryArchivalAfterPreviousFailedDeletion to simulate scenario where an archival call does not delete all the completed .commit files on the timeline and archival is retried again. The expected behavior is that the subsequent archival retry should "clean up" the leftover .commit files. This scenario can happen if org.apache.hudi.client.timeline.HoodieTimelineArchiver#deleteArchivedInstants encounters transient failures when deleting completed instant files, such as due to the edge case that was resolved by HUDI-7207

Impact

None

Risk level (write none, low medium or high below)

If medium or high, explain what verification was done to mitigate the risks. none

Documentation Update

Describe any necessary documentation update if there is any new feature, config, or user-facing change

  • The config description must be updated if new configs are added or the default value of the configs are changed
  • Any new feature or user-facing change requires updating the Hudi website. Please create a Jira ticket, attach the ticket number here and follow the instruction to make changes to the website.

Contributor's checklist

  • [ ] Read through contributor's guide
  • [ ] Change Logs and Impact were stated clearly
  • [ ] Adequate tests were added if applicable
  • [ ] CI passed

kbuci avatar Feb 01 '24 21:02 kbuci

@hudi-bot run azure

kbuci avatar Mar 05 '24 00:03 kbuci

@hudi-bot run azure

yihua avatar Mar 07 '24 06:03 yihua

CI report:

  • 8ac00969346da77a607763f88facee8a518a26c9 Azure: SUCCESS
Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

hudi-bot avatar Mar 07 '24 07:03 hudi-bot