TooManyCooks
TooManyCooks copied to clipboard
hwloc - I/O topology
hwloc exposes some information about adjacency of I/O devices to NUMA nodes. https://dshcherb.github.io/2019/02/02/interpreting-pcie-device-to-cpu-locality-information.html
This could be used to:
- associate I/O executors with specific devices (network, storage, GPU)
- pin I/O executor threads to the directly attached NUMA node
- partition multiple I/O executors for different NUMA nodes / I/O devices
In tandem with explicit NUMA/NUCA partitioning each I/O executor could be associated with a specific CPU executor that runs on the same NUMA node. Thus we could parallelize workloads that involve both I/O and CPU without cross-node sharing.