horaedb icon indicating copy to clipboard operation
horaedb copied to clipboard

Memtable support dedup rows with same primary keys

Open jiacai2050 opened this issue 2 years ago • 0 comments

Describe This Problem

Current memtable implementation will always append row to inner list, which will take more memory than expected when there are duplicated rows, and this will cause SST in level0 is very small, which is unfriendly for query.

Proposal

Dedup rows when insert to memtable for tables in overwritten mode

Additional Context

https://github.com/CeresDB/ceresdb/issues/1020#issuecomment-1608889115

jiacai2050 avatar Jun 27 '23 06:06 jiacai2050