jellyfish icon indicating copy to clipboard operation
jellyfish copied to clipboard

VID experiments with many CPU cores

Open akonring opened this issue 1 year ago • 2 comments

Do VID benchmarks with many CPU cores:

  1. Try (locally) to identify a trend when measuring the duration of disperse while increasing the number of available CPU cores.
  2. Spin up AWS machine with 32-64 cores to confirm the trend more powerful instances.

akonring avatar Feb 08 '24 15:02 akonring

Using RAYON_NUM_THREADS as a proxy for locally confirming the effect of increasing the number of accessible CPUs. Justification: Since Rayon is the primary (parallelization) workhorse in the VID disperse computation (FK20, MSMs), it makes sense to limit its access to threads to identify the trend. Furthermore, Rayon defaults to allocating one thread per core (logical if hyper-threading is supported).

akonring avatar Feb 12 '24 16:02 akonring

All findings documented in this Notion document: https://www.notion.so/espressosys/VID-Optimization-2-CPU-cores-666dfb5c4ae04e9c9b306c210af803a9

akonring avatar Mar 14 '24 12:03 akonring