请问目前支持qwen2吗？

Open Zheng-Jay opened this issue 1 year ago • 3 comments

我看文档里只写支持到qwen1.5，但是issue里不少人有用在qwen2上？

Sep 24 '24 07:09 Zheng-Jay

我想在qwen2上用序列并行训长文本

Sep 24 '24 07:09 Zheng-Jay

Sequence parallel needs transformers <4.43. Same issue in #935

Oct 06 '24 15:10 shiningliang

Sequence parallel needs transformers <4.43. Same issue in #935

训了一版，不过loss看着不太正常，性能也没提升

Oct 14 '24 06:10 Zheng-Jay