Yuxiang Yang comments

Results 18 comments of


                                            Yuxiang Yang

Will move all the non-started work items to next release v0.5.

Can you share me the details reproduce steps? Seems pytorch 2.2 needs a higher version of NCCL and currently we only supports pytorch 2.1 and 1.4

In MS-AMP-Examples, we used optimizer.all_reduce_grads. We need to remove it from examples.

Close this issue since there are no activities more than 9 months

Close the issue since there is no activity for a long time.

Thanks for your attention to our work. We will update Megatron-LM and transformer-engine to latest version.

I have updated the Transformer Engine to v1.1

@b02902131 Thanks. I tried and it worked fine. But I still hope there is an official package in pypi.