Liger-Kernel
Liger-Kernel copied to clipboard
[Feature Request] Add SwiGLU support for Qwen3-VL models
🚀 The feature, motivation and pitch
Problem Description
Can we add SwiGLU kernel support for Qwen3-VL models in Liger-Kernel?
Currently, it appears that passing swiglu=True in the apply_liger_kernel_to_qwen3_vl monkey patch function is a no-op and does not activate the kernel.
References
- Original PR: #911
- Relevant Discussion: Comment Link
Alternatives
No response
Additional context
No response