HaochenZhao

icon indicating an email [email protected]

icon company Peking University icon location An undergraduate from Tong Class, Yuanpei College, Peking University, majoring in artificial intelligence.

Results 1 issues of HaochenZhao

Any support for peft methods on PPO?

7 comment

I am working on a project about applying RL to LLM but only have very limited resource. Hope verl team can support peft methods like lora on your ppo trainer