ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[BUG]: Gemini Plugin,tp=2,TypeError: qwen2model.forward() got an unexpected keyword argument 'force_sp_output_gather'

Open twenty-one-boy opened this issue 8 months ago • 0 comments

Is there an existing issue for this bug?

  • [x] I have searched the existing issues

The bug has not been fixed in the latest main branch

  • [x] I have checked the latest main branch

Do you feel comfortable sharing a concise (minimal) script that reproduces the error? :)

Yes, I will share a minimal reproducible script.

🐛 Describe the bug

colossal=0.4.9,Gemini Plugin,在八张A100显卡上训练QWQ32B,当tp=1时程序正常运行,但当tp=2时报错:TypeError: qwen2model.forward() got an unexpected keyword argument 'force_sp_output_gather'

Environment

No response

twenty-one-boy avatar Apr 16 '25 15:04 twenty-one-boy