fastmoe icon indicating copy to clipboard operation
fastmoe copied to clipboard

fastmoe是否支持微调,page-attention,flasahattention和kvcache,混合精度等

Open PowerDispatch opened this issue 1 year ago • 4 comments

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like A clear and concise description of what you want to happen.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Additional context Add any other context or screenshots about the feature request here.

PowerDispatch avatar Feb 05 '24 03:02 PowerDispatch

是, 是, 是和是, 是...

laekov avatar Feb 05 '24 03:02 laekov

没有找到微调的case, 能帮忙引导一下吗

PowerDispatch avatar Feb 05 '24 05:02 PowerDispatch

我们没有在仓库中包含微调的例子. 请您自行实现.

laekov avatar Feb 05 '24 06:02 laekov

好的,谢谢

PowerDispatch avatar Feb 05 '24 06:02 PowerDispatch