Ruiyan Ma

Request for Examples of Pipeline Parallelism with Multiple Machines in PiPPy

1

I would like to use PiPPy for distributed inference with multiple machines and multiple GPUs. However, most of the test cases in the repository are for single-machine testing. Can you...

Incorrect GPU Assignment in MPI Inter-Node Processing with Single GPU Nodes

3

### System Info - CPU architecture x86_64 - GPU name NVIDIA Tesla T4 - TensorRT-LLM v0.9.0 - NVIDIA driver version 12.3 - OS Ubuntu 22.04.3 ### Who can help? _No...

fix: correct cudaSetDevice error when GPUs per node are fewer than their ranks in inter-node inference

1

#1494