amoro
amoro copied to clipboard
[AMORO-1619] 0.4.x support copy large files when executing full optimizing of Unkeyed Mixed Hive Table
Why are the changes needed?
Close #1619 .
Brief change log
- optimizers support copy files to new hive locations if all files in this task are large files
- full optimizing plan of Unkeyed Mixed Hive Table supports split large files and small files into different tasks
How was this patch tested?
-
[x] Add some test cases that check the changes thoroughly including negative and positive cases if possible
-
[ ] Add screenshots for manual tests if appropriate
-
[x] Run test locally before making a pull request
Documentation
- Does this pull request introduce a new feature? (yes / no)
- If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)