InternEvo icon indicating copy to clipboard operation
InternEvo copied to clipboard

Published 20 hours ago • verified publisher icon InternLM

[Feature] support sequence parallel in head layer and embedding layer

Open sunpengsdu opened this issue 1 year ago • 1 comments

Describe the feature

they should not in separated parameter group

Will you implement it?

  • [X] I would like to implement this feature and create a PR!

sunpengsdu avatar Mar 20 '24 02:03 sunpengsdu