lodestar icon indicating copy to clipboard operation
lodestar copied to clipboard

[fulu] performance issue deserializing DataColumnSidecar

Open twoeths opened this issue 1 month ago • 0 comments

Describe the bug

there is some significant time to deserialize gossipsub message, which happens multiple times per slot

in this example it's already >= 700ms

Image

my best guess is for gossip DataColumnSidecar message

update:

  • confirm that it's DataColumnSidecar message that takes > 100ms to deserialize because I cannot find it in this old profile when hoodi was not forked

v1.34.0_1k_main.cpuprofile.zip

it's likely that this is due to memory allocation where NodeJS works with a lot of small Uint8Arrays

  • it also happens in req/resp as well
Image

Expected behavior

no performance issue this is part of #8619

Steps to reproduce

No response

Additional context

No response

Operating system

Linux

Lodestar version or commit hash

v1.36.0

twoeths avatar Nov 21 '25 16:11 twoeths