LSC527 comments

Repositories
Issues
Comments

Results 12 comments of


                                            LSC527

[Bug] In step3, a runtime error will be thrown when inference_tp_size>1

> > red the same problem. Any suggestions on alternative of DeepSpeed-Chat for RLHF tr > > I have found that there is a candidate [pull request](https://github.com/microsoft/DeepSpeed/pull/4493) to address this...

"RuntimeError: The size of tensor a (5120) must match the size of tensor b (20480) at non-singleton dimension 0" in step3

Same to me. It seems a tp related bug. It works fine when not enabling tp.