Eric Steinberger issues

Repositories
Issues
Comments

Results 2 issues of


Eric Steinberger

[Bug] - summing over DP instead of MP

Hi Deepspeed team! Should this be summing over the MP group rather than the DP group? The comment says MP and the code does DP. https://github.com/microsoft/DeepSpeed/blob/b3388e1418e80141a902886dec39127b851a1f0a/deepspeed/runtime/zero/stage_1_and_2.py#L1156

[Feature] ray serve + model parallel deepspeed inference

### Search before asking - [X] I had searched in the [issues](https://github.com/ray-project/ray/issues) and found no similar feature requirement. ### Description Hi folks, I'm trying to split a model across multiple...

enhancement

serve