TooManyCooks icon indicating copy to clipboard operation
TooManyCooks copied to clipboard

hwloc - I/O topology

Open tzcnt opened this issue 9 months ago • 0 comments

hwloc exposes some information about adjacency of I/O devices to NUMA nodes. https://dshcherb.github.io/2019/02/02/interpreting-pcie-device-to-cpu-locality-information.html

This could be used to:

  • associate I/O executors with specific devices (network, storage, GPU)
  • pin I/O executor threads to the directly attached NUMA node
  • partition multiple I/O executors for different NUMA nodes / I/O devices

In tandem with explicit NUMA/NUCA partitioning each I/O executor could be associated with a specific CPU executor that runs on the same NUMA node. Thus we could parallelize workloads that involve both I/O and CPU without cross-node sharing.

tzcnt avatar Apr 09 '25 15:04 tzcnt