Liger-Kernel icon indicating copy to clipboard operation
Liger-Kernel copied to clipboard

[Feature Request] Add SwiGLU support for Qwen3-VL models

Open matthewdm0816 opened this issue 1 week ago • 0 comments

🚀 The feature, motivation and pitch

Problem Description

Can we add SwiGLU kernel support for Qwen3-VL models in Liger-Kernel?

Currently, it appears that passing swiglu=True in the apply_liger_kernel_to_qwen3_vl monkey patch function is a no-op and does not activate the kernel.

References

Alternatives

No response

Additional context

No response

matthewdm0816 avatar Nov 28 '25 17:11 matthewdm0816