Juanhui28 issues

Repositories
Issues
Comments

Results 2 issues of


                                            Juanhui28

Example to run Megatron

Hi, Thanks for the exciting work!! I want to use the parallel methods when running Megatron, but seems there isn't an example/script to run Megatron and I cannot find a...

loss function error in tutorial /0_basic.py

hello, Thanks for providing the amazon repo. But I have a question regarding the loss function in `tutorial /0_basic.py`. The loss function is `loss_func = torch.nn.CrossEntropyLoss()` which applies the softmax...