DeepSpeed icon indicating copy to clipboard operation
DeepSpeed copied to clipboard
verified publisher icon microsoft

[REQUEST] DeepSpeed-Ulysses with the Pure Deepspeed Zero

Open ppengtang opened this issue 1 year ago • 0 comments

Hi DeepSpeed folks. The issue here mentioned there will be a general solution for DeepSpeed-Ulysses with DeepSpeed zero. Can you share when it will be available? Thanks!

ppengtang avatar May 16 '24 21:05 ppengtang