jellyfish
jellyfish copied to clipboard
VID experiments with many CPU cores
Do VID benchmarks with many CPU cores:
- Try (locally) to identify a trend when measuring the duration of disperse while increasing the number of available CPU cores.
- Spin up AWS machine with 32-64 cores to confirm the trend more powerful instances.
Using RAYON_NUM_THREADS
as a proxy for locally confirming the effect of increasing the number of accessible CPUs.
Justification: Since Rayon is the primary (parallelization) workhorse in the VID disperse computation (FK20, MSMs), it makes sense to limit its access to threads to identify the trend. Furthermore, Rayon defaults to allocating one thread per core (logical if hyper-threading is supported).
All findings documented in this Notion document: https://www.notion.so/espressosys/VID-Optimization-2-CPU-cores-666dfb5c4ae04e9c9b306c210af803a9