presto
presto copied to clipboard
Reduce memory usage of StreamDescriptor in Flat Maps
Flat Maps StreamDescriptor consume large amount of memory.
- Make additional sequences point to the base sequence to avoid duplicating references.
- Do not store nested streams, as they are computed, stored and retrieved only once in the constructor of the reader.
Should reduce typical flat map reader memory consumption by about 10-15 MB.
Test plan - Will add new tests in a modified commit.
== NO RELEASE NOTE ==