It was found that the deepspeed folder exists. Has the deepspeed source code been modified in this project?

Open daneren opened this issue 2 years ago • 3 comments

Dec 27 '23 06:12 daneren

Hi,

Yes, I made a bit modification, so that this deepspeed is a bit different from official codebase.

Dec 27 '23 06:12 CoinCheung

Thanks,

I am looking for a training solution that does not modify deepspeed and can use pp+zero. Can you explain the difference between deepspeed, or which commit can reflect the modification?

Dec 27 '23 08:12 daneren

Hi,

I am afraid that I have modified it from the very beginning, so currently there is no such commit that depends on non-modified deepspeed.

Dec 28 '23 12:12 CoinCheung