kang sheng

icon indicating a website link https://techkang.github.io/ icon indicating an email [email protected]

icon company Meituan icon location Beijing

Results 15 comments of kang sheng

Add DDP token averaging for equivalent non-parallel training similar to #34191

Thanks, I already created the pull request and tested on my machine.

Fail to save megatron distributed checkpoints when using megatron as a back-end, and distributed checkpoint as actor model

You can use mbrige to save transformers' type checkpoint. You can refer to this script:https://github.com/volcengine/verl/blob/main/examples/grpo_trainer/run_qwen3-235b_megatron_96gb.sh#L96.

Fail to save megatron distributed checkpoints when using megatron as a back-end, and distributed checkpoint as actor model

It's related to mbridge. Maybe @ISEEKYAN can help.

Fail to save megatron distributed checkpoints when using megatron as a back-end, and distributed checkpoint as actor model

cc @ETOgaosion

Qwen3-30B-A3B OOM with GRPO on 4x8H200 141G

Can you test the recommanded script? https://github.com/volcengine/verl/blob/main/examples/grpo_trainer/run_qwen3moe-30b_megatron_96gb.sh