adol001

I do not have permission to add or remove reviewers in Alluxio repo. When requesting @jiacheliu3 re-review, @tcrain disappeared from the reviewer's list, but github shows that I removed tcrain...

> > https://github.com/Alluxio/alluxio/blob/master/core/server/master/src/main/java/alluxio/master/journal/tool/AbstractJournalDumper.java#L88 > > @adol001 See above i think that class needs to be updated to catch your new checkpoint type. If you feel it will take much code...

@liuyongqing 100 million files and nvme ssd | | compress |decompress | | --- | ---: |---:| | targz | 448521ms |56096ms | | zip(thread 5, compress level 6) |...

This pull request is very effective for synchronizing folders with more than 100 million items. For example, synchronizing a folder of /2021/days/items structure, the current implementation requires a large amount...

> LGTM with a minor comment on the property key. Good to merge after that is resolved. Thanks so much! Fixed. Thank you for your review!

@yuzhu 7 layers of directories, 10 subdirectories in each layer, 10 files in the deepest directory, a total of 11,111,111 items to be synchronized. Ufs is a local ssd disk....

@yuzhu not 1111111，the total num is 11111111。 Updated

In addition to checkpoint, backup is also single-threaded gz. It should also be optimized too.

Refine checkpoint by Parallel zip compression and decompression https://github.com/Alluxio/alluxio/pull/16151 The current implementation of backup, instead of executing backup, it is better to reload it

但是这个在cmteb上并没有取得特别大的领先分数，体积达到了15GB，很耗计算资源的