sarrahbbh
Results
1
issues of
sarrahbbh
**Describe the bug** Hello, I'm trying to train a 13b language model on 2 A100 80GB GPUs using ZeRO-2, but DeepSpeed doesn't seem to be using both GPUs for the...
bug
training