risinglight icon indicating copy to clipboard operation
risinglight copied to clipboard

storage: select compaction strategy using statistics

Open skyzh opened this issue 3 years ago • 4 comments

If we find distinct value statistics is very small compared with row counts, we can use RLE encoding when building RowSets.

https://github.com/risinglightdb/risinglight/blob/65372ee4da36bada718a6ab00cdba865ba554e5e/src/storage/secondary/compactor.rs#L93-L96

skyzh avatar Apr 24 '22 13:04 skyzh

newbie here, can I give this a try?

jess-x avatar Apr 27 '22 07:04 jess-x

Any progress? I am also very interested in it.

noneback avatar Jun 14 '22 07:06 noneback

Hmm, maybe you can take over this as it has been nearly a month that we haven't heard back from @jess-x 🤣

skyzh avatar Jun 14 '22 07:06 skyzh

hi, feel free to take over. didn't have the bandwidth this past month 🥲

jess-x avatar Jun 14 '22 20:06 jess-x