databend icon indicating copy to clipboard operation
databend copied to clipboard

feat: reduce memory copy during the compact process

Open SkyFan2002 opened this issue 9 months ago โ€ข 1 comments

I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

Instead of concatenating multiple DataBlocks into a single DataBlock, directly writing multiple DataBlocks into a single table block.

  • Fixes #15340

Tests

  • [ ] Unit Test
  • [ ] Logic Test
  • [x] Benchmark Test
  • [ ] No Test - Explain why

Type of change

  • [ ] Bug Fix (non-breaking change which fixes an issue)
  • [ ] New Feature (non-breaking change which adds functionality)
  • [ ] Breaking Change (fix or feature that could cause existing functionality not to work as expected)
  • [ ] Documentation Update
  • [ ] Refactoring
  • [x] Performance Improvement
  • [ ] Other (please describe):

This change isโ€‚Reviewable

SkyFan2002 avatar May 21 '24 09:05 SkyFan2002