starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

[Enhancement] assign morsels uniformly among ScanOperators to avoid skew

Open mofeiatwork opened this issue 1 year ago • 10 comments

What type of PR is this:

  • [ ] bug
  • [ ] feature
  • [x] enhancement
  • [ ] refactor
  • [ ] others

Which issues of this PR fixes :

Fixes #

Problem Summary(Required) :

When morsel count is less than dop * io_parallelism, assign morsels to scan operators uniformly to avoid skew.

Checklist:

  • [ ] I have added test cases for my bug fix or my new feature
  • [ ] I have added user document for my new feature or new function

mofeiatwork avatar Aug 11 '22 08:08 mofeiatwork

@Mergifyio backport branch-2.3 branch-2.4

mofeiatwork avatar Aug 11 '22 08:08 mofeiatwork

backport branch-2.3 branch-2.4

✅ Backports have been created

mergify[bot] avatar Aug 11 '22 08:08 mergify[bot]

run starrocks_admit_test

kangkaisen avatar Aug 11 '22 09:08 kangkaisen

@Mergifyio rebase

mofeiatwork avatar Aug 11 '22 12:08 mofeiatwork

rebase

✅ Branch has been successfully rebased

mergify[bot] avatar Aug 11 '22 12:08 mergify[bot]

run all

mofeiatwork avatar Aug 12 '22 02:08 mofeiatwork

run starrocks_admit_test

mofeiatwork avatar Aug 12 '22 03:08 mofeiatwork

run starrocks_admit_test

mofeiatwork avatar Aug 12 '22 06:08 mofeiatwork

run starrocks_admit_test

wanpengfei-git avatar Aug 12 '22 07:08 wanpengfei-git

run starrocks_admit_test

mofeiatwork avatar Aug 12 '22 08:08 mofeiatwork