amoro icon indicating copy to clipboard operation
amoro copied to clipboard

[AMORO-1619] 0.4.x support copy large files when executing full optimizing of Unkeyed Mixed Hive Table

Open wangtaohz opened this issue 1 year ago • 3 comments

Why are the changes needed?

Close #1619 .

Brief change log

  • optimizers support copy files to new hive locations if all files in this task are large files
  • full optimizing plan of Unkeyed Mixed Hive Table supports split large files and small files into different tasks

How was this patch tested?

  • [x] Add some test cases that check the changes thoroughly including negative and positive cases if possible

  • [ ] Add screenshots for manual tests if appropriate

  • [x] Run test locally before making a pull request

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

wangtaohz avatar Nov 24 '23 11:11 wangtaohz