xccl

xccl copied to clipboard

lappazos

Sergei-Lebedev

Adding the XCCL DPU team, and DPU daemon

4

This PR adds the new DPU team as well as a contrib directory with the accompanying DPU daemon app. This is a first but comprehensive attempt which successfully runs pytorch...

janjust

lappazos

lappazos

Poor performance with NVLink

2

I was running some benchmarks with torch-ucc using xccl for collectives, and I noticed very bad performance compared to NCCL. See numbers here: https://gist.github.com/froody/a86a5b2c5d9f46aedba7e930f4b4e08d It's possible this is due to...

froody