database-stream-processor icon indicating copy to clipboard operation
database-stream-processor copied to clipboard
verified publisher icon vmware

Use SIMD sorting for consolidation where applicable

Open Kixiron opened this issue 3 years ago • 2 comments

A lot of our sorting and more general consolidation can be done faster via SIMD. This'd be a huge win if we got it working as sorting currently takes a pretty significant part of our runtime

Kixiron avatar Aug 03 '22 16:08 Kixiron

The database community has a bunch of papers on implementing operators with SIMD:

https://dl.acm.org/doi/pdf/10.1145/2588555.2610522 https://faculty.cc.gatech.edu/~jarulraj/courses/4420-s19/papers/20-sortmergejoins/p85-balkesen.pdf http://dbis.cs.tu-dortmund.de/cms/en/publications/2012/frequent-item-cpu/kdd2012-submission.pdf https://dl.acm.org/doi/pdf/10.1145/2882903.2882948

gz avatar Sep 28 '22 17:09 gz

  • Origami: A High-Performance Mergesort Framework (link)
  • SIMD- and Cache-Friendly Algorithm for Sorting an Array of Structures (link)

Kixiron avatar Sep 28 '22 18:09 Kixiron