starrocks icon indicating copy to clipboard operation
starrocks copied to clipboard

Published 20 hours ago • verified publisher icon StarRocks

[Enhancement]add AVX512 implementation of bit unpack

Open wanweiqiangintel opened this issue 2 years ago • 5 comments

What type of PR is this：

  • [ ] BugFix
  • [ ] Feature
  • [x] Enhancement
  • [ ] Refactor
  • [ ] UT
  • [ ] Doc
  • [ ] Tool

Accelerate bit unpack with AVX512 intrinsic, get about 3~8X speedup in the microbenchmark

wanweiqiangintel avatar Mar 01 '23 09:03 wanweiqiangintel

CLA assistant check
All committers have signed the CLA.

CLAassistant avatar Mar 15 '23 03:03 CLAassistant

Hi, @imay, I have added the unit test of the simd bitunpack function and passed the CI, what can I do to go further? Thanks!

wanweiqiangintel avatar Apr 07 '23 14:04 wanweiqiangintel

@wanweiqiangintel sorry for late reply, would you want to continue this PR?

alvin-celerdata avatar Jun 07 '25 15:06 alvin-celerdata

@wanweiqiangintel

do you have any performance benchmark for this implementation? any improvement comparing to old implementation?

This routine is actually very critical for parquet reader. And if it improves a lot, then it will be huge help for parquet reader

dirtysalt avatar Jun 08 '25 06:06 dirtysalt

@wanweiqiangintel do you have time to follow this pr?

dirtysalt avatar Jun 18 '25 07:06 dirtysalt