TensorRT icon indicating copy to clipboard operation
TensorRT copied to clipboard
verified publisher icon pytorch

🐛 [Bug]Torch distributed data parallel accelerate GPT2 example failing

Open apbose opened this issue 3 months ago • 0 comments

Torch distributed data parallel accelerate GPT2 example failing

cd examples/distributed_inference
CUDA_VISIBLE_DEVICES=0 accelerate launch data_parallel_gpt2.py <single GPU>
accelerate launch data_parallel_gpt2.py

torch 2.9.0.dev20250821+cu129 torch_tensorrt 2.10.0.dev0+0 accelerate 1.10.1

apbose avatar Oct 16 '25 17:10 apbose