inlong
inlong copied to clipboard
[Feature][Sort] Dlc load data support auto compact file
Description
Dlc load data produce a lot of small files every checkpoint. We want to add an inline batch compact task after every commit snapshot.
Use case
No response
Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct