paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[improve] extract field in value that already contains in key

Open leaves12138 opened this issue 2 years ago • 0 comments

The key-value storage (in primary-key table) are redundant. Now, the format of a row is: _KEY_a, _KEY_b, _FIELD_SEQUENCE, _ROW_KIND, a, b, c, d, e, f, g The column "a" and "b" have double restored. A optimization is:

convert    _KEY_a, _KEY_b, _FIELD_SEQUENCE, _ROW_KIND, a, b, c, d, e, f, g

to         _KEY_a, _KEY_b, _FIELD_SEQUENCE, _ROW_KIND, c, d, e, f, g

While reading, we find the a, b from key and fill them to value.

This PR is not complete, unit tests and compatibility test will need to be done.

leaves12138 avatar Aug 15 '23 14:08 leaves12138