Peng Cao

icon location I am a M.Sc student studying at University of Southern California and I received my my B.Sc. from University of Electronic Science and Technology of China.

Results 3 comments of Peng Cao

[BUG] hybrid_engine for zero 3 seems invalid

I meet the same problem

what(): CUDA error: an illegal memory access was encountered

same

The reward in step3 seems to be completely random without any noticeable increase.

> Thank you for letting us know. We are now investigating if HE has any unexpected behavior @yaozhewei I also encountered the same issue at deepspeed==0.9.0 and deepspeed==0.9.1. It can...