jayargo comments

Repositories
Issues
Comments

Results 1 comments of


                                            jayargo

[BUG] Cannot run DeepSpeed with transformers on NVIDIA Tesla T4 GPU

@RezaYazdaniAminabadi I'm observing the same behavior on an A100-SXM4-40GB system. Using the same steps to reproduce as @lanking520, the single GPU run works but multiple GPUs produces garbage output. `[{'generated_text':...