Peng Tang

icon indicating a website link https://pengtang.xyz icon indicating an email [email protected]

icon company Amazon Web Services icon location Pasadena, CA, USA icon location Researcher in computer vision + language.

Results 1 issues of Peng Tang

[REQUEST] DeepSpeed-Ulysses with the Pure Deepspeed Zero

Hi DeepSpeed folks. The issue [here](https://github.com/microsoft/DeepSpeed/issues/5348#issuecomment-2035809961) mentioned there will be a general solution for DeepSpeed-Ulysses with DeepSpeed zero. Can you share when it will be available? Thanks!

enhancement