Evan Chan

The next step here is to generate load and try to reproduce the "gradual memory increase". We likely need to do this in a deployed environment. The goal is to...

I'd like to update with all the work that I put into this this week. 1. Added Narwhal memory profiling with an option to add Jemalloc profiling in Narwhal's node,...

There is also the issue that jeprof isn't the easiest profiling tool to use. There's no nice UI, there's no easy graph or ordering tree or anything to analyze things....

/cc a few others who have expressed interest... @laura-makdah @todd-mystenlabs I just realized what would be the perfect intermediate solution, it would just take a few days to write and...

PR out to enable two different types of memory profiling via env vars at runtime: https://github.com/MystenLabs/sui-operations/pull/159 This is part 1 of 2. Part 2 involves building debug images or Docker...

PR is merged. Next part is building an image with debug build so that enabled profiling data can be analyzed.

Update: - Sui has a PR merged that enables building Docker images with debug symbols for profiling - PR is out for workflow to build Docker image with profiling tools:...

This is more or less done now. Validator images deployed to any environment can enable profiling via environment variables. Right now there are two options, Jemalloc and Bytehound, and neither...

@kchalkias regarding encoding, a bitmap uses only 1 bit per authority and does not have an upper bound limit like a fixed size u8. Let's say for up to 256...

@kchalkias yes that's a good summary.