twenty-one-boy

Results 3 issues of twenty-one-boy

[BUG]: Hybrid Parallel Plugin，zero_stage=1，zero_cpu_offload=true，terminate called after throwing an instance of 'c10::Error' what() Cuda error: unspecified launch failure cuda kernel errors might be asynchronously reported at some other API call

1 comment

### Is there an existing issue for this bug? - [x] I have searched the existing issues ### The bug has not been fixed in the latest main branch -...

bug

[BUG]: Gemini Plugin，tp=2，TypeError: qwen2model.forward() got an unexpected keyword argument 'force_sp_output_gather'

### Is there an existing issue for this bug? - [x] I have searched the existing issues ### The bug has not been fixed in the latest main branch -...

bug

[BUG]: Hybrid Parallel Plugin PP=1 TypeError: qwen2model.forward() got an unexpected keyword argument 'force_sp_output_gather'

### Is there an existing issue for this bug? - [x] I have searched the existing issues ### The bug has not been fixed in the latest main branch -...

bug