ColossalAI
ColossalAI copied to clipboard
[FEATURE]: Refactor DTensor
Describe the feature
We have already built a DTensor demo as described in #2957 using the components of automatic parallelism module. Recently, we refactor/implement some key compents for DTensor, we should refactor the DTensor with the fresh compents.