fastmoe
fastmoe copied to clipboard
Do We support DeepSpeed training? Thanks.
Is your feature request related to a problem? Please describe. My model is trained with Deepspeed + zero2 framework, i want to know how can i use fastmoe to train or inference my code simply.
Describe the solution you'd like give a clear tutorial
Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.
Additional context Add any other context or screenshots about the feature request here.