ColossalAI
ColossalAI copied to clipboard
[DTensor] refactor dtensor with new components
📌 Checklist before creating the PR
- [x] I have created an issue for this PR for traceability
- [x] The title follows the standard format:
[doc/gemini/tensor/...]: A concise description - [x] I have added relevant tags if possible for us to better distinguish different PRs
🚨 Issue number
resolved #3091
📝 What does this PR do?
We have already built a DTensor demo as described in https://github.com/hpcaitech/ColossalAI/issues/2957 using the components of automatic parallelism module. Recently, we refactor/implement some key compents for DTensor, we should refactor the DTensor with the fresh compents.

💥 Checklist before requesting a review
- [x] I have linked my PR to an issue (instruction)
- [x] My issue clearly describes the problem/feature/proposal, with diagrams/charts/table/code if possible
- [x] I have performed a self-review of my code
- [x] I have added thorough tests.
- [x] I have added docstrings for all the functions/methods I implemented
⭐️ Do you enjoy contributing to Colossal-AI?
- [x] 🌝 Yes, I do.
- [ ] 🌚 No, I don't.
Tell us more if you don't enjoy contributing to Colossal-AI.
The code coverage for the changed files is 87%.
Click me to view the complete report
Name Stmts Miss Cover
--------------------------------------------------------------------
colossalai/tensor/d_tensor/d_tensor.py 63 12 81%
tests/test_tensor/test_dtensor/test_dtensor.py 71 5 93%
--------------------------------------------------------------------
TOTAL 134 17 87%
The code coverage for the changed files is 87%.
Click me to view the complete report
Name Stmts Miss Cover
--------------------------------------------------------------------
colossalai/tensor/d_tensor/d_tensor.py 63 12 81%
tests/test_tensor/test_dtensor/test_dtensor.py 71 5 93%
--------------------------------------------------------------------
TOTAL 134 17 87%
The code coverage for the changed files is %.
Click me to view the complete report
Name Stmts Miss Cover
--------------------------------------------------------------------
colossalai/tensor/d_tensor/d_tensor.py 63 12 81%
colossalai/tensor/d_tensor/layout_converter.py 200 18 91%
tests/test_tensor/test_dtensor/test_dtensor.py 71 5 93%
--------------------------------------------------------------------
TOTAL 334 35 90%
You should add keywords such as fixed and resolvedbefore your issue number to link your PR to the issue.
You should add keywords such as
fixedandresolvedbefore your issue number to link your PR to the issue.
Done.