lmdeploy
lmdeploy copied to clipboard
Optimize moe
similar optimization https://github.com/InternLM/lmdeploy/pull/1515 for deepseek-moe, qwen2-moe, dbrx