Zhi-Kai Xu
Results
1
issues of
Zhi-Kai Xu
**Edit - 1** The same problem occurs when using ZeRO2 with offloading. **Describe the bug** I am trying to train Llama2-7B-fp16 using 4 V100. I use ZeRO-3 without offloading, with...
bug
training