parca-agent icon indicating copy to clipboard operation
parca-agent copied to clipboard

Substantially increased memory overhead

Open dreamerlzl opened this issue 1 year ago • 4 comments

Parca-agent pods seem to use more memory with v0.32.0

A memory profiling is like the following:

profile002

The total memory usage of the parca-agent pod can surpass 500MB on my side from time to time without much conf change.

dreamerlzl avatar Oct 18 '24 08:10 dreamerlzl

Testing v0.34.0 for this to see whether it has been fixed...

dreamerlzl avatar Oct 18 '24 08:10 dreamerlzl

Thank you for reporting! Which version were you on before, and how much was it before?

brancz avatar Oct 18 '24 15:10 brancz

Thank you for reporting! Which version were you on before, and how much was it before?

I am using v0.31 before, and the memory overhead of that is within 200 ~ 350 MB

dreamerlzl avatar Oct 22 '24 02:10 dreamerlzl

/debug/pprof/heap?debug=1 heap_debug_1.txt

/debug/pprof/heap heap.gz

the alloc_space looks like this: Screenshot 2024-10-22 at 10 17 49

it seems like we can only set a higher memory limit; there are no filtering at all in opentelemetry-ebpf-profiler and all the processes' ELFs are handled and thus memory/heapIdle spikes could be high

dreamerlzl avatar Oct 22 '24 02:10 dreamerlzl