Liger-Kernel icon indicating copy to clipboard operation
Liger-Kernel copied to clipboard

Published 20 hours ago • verified publisher icon linkedin

Moe kernel for latest transformers v5

Open Tcc0403 opened this issue 1 week ago • 0 comments

🐛 Describe the bug

experts will no longer be just a ModuleList of MLP layers. It's time to write moe kernel for moe layers!

https://github.com/huggingface/transformers/pull/41580/files#diff-0855b77fc27ad9449158a1c74953f909b011c00de7125f7c8e68d0ff209c092aR218

Reproduce

No response

Versions

transformers v5

Tcc0403 avatar Nov 28 '25 19:11 Tcc0403