ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

[FEATURE]: support dit in Shardformer

Open likelyzhao opened this issue 11 months ago • 0 comments

Describe the feature

the dit model is the basic model to form sora , consider to suppport layer Parallel in ColossalAI ?

likelyzhao avatar Mar 23 '24 08:03 likelyzhao