SwanLab icon indicating copy to clipboard operation
SwanLab copied to clipboard

Published 20 hours ago • verified publisher icon SwanHubX

[REQUEST] support Megatron-LM

Open dawnranger opened this issue 9 months ago • 1 comments

🤩 Features description

support Megatron-LM: https://github.com/NVIDIA/Megatron-LM

🚑 Any additional

https://github.com/NVIDIA/Megatron-LM/blob/core_r0.8.0/megatron/training/training.py#L656

dawnranger avatar Mar 13 '25 06:03 dawnranger

Yeah, we are also very pleased to integrate with Megatron-LM.

👀Have a look @ShaohonChen

Zeyi-Lin avatar Mar 13 '25 07:03 Zeyi-Lin