llm_rlhf icon indicating copy to clipboard operation
llm_rlhf copied to clipboard
verified publisher icon ssbuild

About Qlora

Open Iambestfeed opened this issue 2 years ago • 0 comments

Now I have implemented Qlora for SFT and reward model but I am quite confused when I do Qlora for PPO, do you plan to integrate PPO into repo?

Iambestfeed avatar Jun 23 '23 11:06 Iambestfeed