LLM-Pruner icon indicating copy to clipboard operation
LLM-Pruner copied to clipboard

Adaption for Qwen3

Open Sting-Scorpion opened this issue 6 months ago • 0 comments

Thank you for your solid work. I would like to ask if the code will be suitable for Qwen3 models, which added q_norm and k_norm in self_attention and would lead to not pruning self_attn layers.

Sting-Scorpion avatar Jun 03 '25 06:06 Sting-Scorpion