ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

[FEATURE]: Add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM

Open GuangyaoZhang opened this issue 1 year ago • 0 comments

Describe the feature

Please add Ulysses Sequence Parallelism support for Command-R, Qwen2 and ChatGLM

GuangyaoZhang avatar Jun 25 '24 09:06 GuangyaoZhang