ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

When will ColossalAI support 2D, 2.5D, 3D tensor parallelism?

Open AmazDeng opened this issue 4 months ago • 0 comments

I've noticed that the latest version of ColossalAI does not support 2D, 2.5D, and 3D tensor parallelism. I would like to know, according to ColossalAI's roadmap, when Shardformer will support 2D, 2.5D, and 3D tensor parallelism?

AmazDeng avatar Aug 25 '25 11:08 AmazDeng