ColossalAI
ColossalAI copied to clipboard
[fx] An experimental version of ColoTracer.'
What's new
A new version of ColoTracer
. Currently supports:
- [x] torchvision
- [x] timm
- [x] huggingface
- [x] albert
- [x] bert
- [x] diffusion
- [x] gpt
- [x] opt
- [x] t5
- [ ] torchaudio
- [x] transformer
- [x] general
- [ ] gru
- [ ] torchrec
Once finalized, I will modify all the test cases.
Could you please change the code on origin file instead of working on experimental file? In that way, the changes are outstanding from the origin file, which makes me easy to review your code.