megatron topic
List
megatron repositories
megadlbot_oss
178
Stars
170
Forks
Watchers
Megatron was a telegram file management bot that helped a lot of users, specially movie channel managers to upload their files to telegram by just providing a link to it. The project initially started...
ms-swift
11.9k
Stars
1.1k
Forks
11.9k
Watchers
Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3, Qwen3-MoE, DeepSeek-R1, GLM4.5, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM4.5v, Llava, Phi...
pipegoose
77
Stars
17
Forks
Watchers
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
LLaMA-Megatron
26
Stars
2
Forks
Watchers
A LLaMA1/LLaMA12 Megatron implement.