mytopling icon indicating copy to clipboard operation
mytopling copied to clipboard

Generate data pack/unpack code at runtime

Open rockeet opened this issue 2 years ago • 0 comments

Now MyTopling inherited MyRocks's pack/unpack code, which is slow because it pack/unpack data dynamically, in table scan stage, pack/unpack consume , as show in this flame graph: image

We can optimize it as below:

  1. generate pack/unpack C++ code on create/alter table and create index
  2. compile the code into shared lib
  3. calling pack/unpack function in the shared lib

We expecting this will greatly improve pack/unpack performance.

rockeet avatar Jan 09 '23 09:01 rockeet