xla icon indicating copy to clipboard operation
xla copied to clipboard

[XLA:GPU] Support mocking multi-gpu execution from a single GPU

Open copybara-service[bot] opened this issue 1 year ago • 0 comments

[XLA:GPU] Support mocking multi-gpu execution from a single GPU

Allows running multi-GPU HLOs on a machine with a single GPU, when --enable_mock_nccl is used.

Example usage:

./tools/multihost_hlo_runner/hlo_runner_main  --device_type=gpu --use_spmd_partitioning --num_partitions=16 --num_replicas=1 --enable_mock_nccl multi_gpu.hlo

copybara-service[bot] avatar Aug 08 '24 14:08 copybara-service[bot]