Liger-Kernel icon indicating copy to clipboard operation
Liger-Kernel copied to clipboard

Published 20 hours ago • verified publisher icon linkedin

Problem when running GRPO with liger kernel.

Open Leon1207 opened this issue 4 months ago • 3 comments

Hi, thanks for your work. When I run Qwen2.5-VL using GRPO with liger kernel in ms-swift, it happens:

Image

But when I turn --use_liger_kernel into false, it can run correctly. My version: torch: 2.7.1 cuda: 128 transformers: 4.53.2 flash_attn: 2.8.1 liger kernel: 0.6.0

How to solve this? Dose it related to the LigerFusedLinearGRPOLoss? Thanks!

Leon1207 avatar Jul 15 '25 11:07 Leon1207