Lixu2512

Qwen3-VL-235B-A22B-thinking模型是否支持ppo训练？ 我已经被折磨很久了。help！

1

### Reminder - [x] I have read the above rules and searched the existing issues. ### System Info - `llamafactory` version: 0.9.4.dev0 - Platform: Linux-6.8.0-85-generic-x86_64-with-glibc2.39 - Python version: 3.12.7 -...

Qwen3-VL-30B-A3B-thinking模型使用api作为奖励模型进行ppo训练，trl调用deepspeed不存在方法

1

### Reminder - [x] I have read the above rules and searched the existing issues. ### System Info - `llamafactory` version: 0.9.4.dev0 - Platform: Linux-6.8.0-85-generic-x86_64-with-glibc2.39 - Python version: 3.11.1 -...