fastmoe icon indicating copy to clipboard operation
fastmoe copied to clipboard

Do We support DeepSpeed training? Thanks.

Open lzl-mt opened this issue 5 months ago • 1 comments

Is your feature request related to a problem? Please describe. My model is trained with Deepspeed + zero2 framework, i want to know how can i use fastmoe to train or inference my code simply.

Describe the solution you'd like give a clear tutorial

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.

lzl-mt avatar Sep 09 '24 11:09 lzl-mt