HH&CC issues

Repositories
Issues
Comments

Results 2 issues of


                                            HH&CC

What is the MFU of GLM-130B during training?

such as title

[QUESTION] why pipeline-model-parallel size should be greater than 2 with interleaved schedule ？

**Your question** Ask a clear and concise question about Megatron-LM. ![image](https://github.com/NVIDIA/Megatron-LM/assets/34435196/33f48852-3cc4-4464-b0e2-02e468b9ec12)