column icon indicating copy to clipboard operation
column copied to clipboard

possible memory leak when taking a snapshot

Open ami-m opened this issue 2 years ago • 2 comments

I created a poc with column, it got hit with incoming data for a bout an hour, and after that I ran a loop that created a snapshot of the data once a minute.

I monitored the memory consumption and the memory usage jumped (and was not released) every time a snapshot was taken.

Other than closing the underlying writer, is there anything else I should have released?

if not, then I suspect a memory leak. pprof points the finger at the column.grow and s2.NewWriter as possible culprits.

ami-m avatar Jan 15 '23 11:01 ami-m

Will need to investigate this, do you have a test case?

kelindar avatar Jul 03 '23 16:07 kelindar

Yes, I also have this problem, construct a loop to execute the snapshot, you will find that there is a fixed increase in memory, the Snapshot method creates an s2.NewWriter, does not seem to free it

tanzegen avatar Jan 10 '24 09:01 tanzegen