axlearn icon indicating copy to clipboard operation
axlearn copied to clipboard
verified publisher icon apple

Support empty folder deletion for HNS bucket with Orbax

Open deepikarajani24 opened this issue 5 months ago • 1 comments

Orbax made a change to support empty folders deletion which require enable_hns_rmtree flag to be True in CheckpointManagerOptions.

  • Tested orbax regular checkpoint with HNS bucket with keep_last_n as 3, and confirmed only latest 3 checkpoint folders were left and rest were deleted. Also, without this change confirmed all the checkpoint folders would exist and none would be deleted.
  • This change would help with improved listing for HNS bucket which gets slow if empty folders are present

deepikarajani24 avatar Jul 07 '25 03:07 deepikarajani24

This pull request has been automatically marked as stale because it has been inactive for 60 days. It will be closed in 7 days if no further activity occurs. If you would like to continue working on this, please remove the stale label or leave a comment.

github-actions[bot] avatar Oct 19 '25 02:10 github-actions[bot]