ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

The rm model which ppo train step3 requires ，but I can not find where to input this param in example ! pls help me out

Open taishiciR opened this issue 2 years ago • 1 comments

https://github.com/hpcaitech/ColossalAI/blob/82503a96f20c2e61016af78445f9d1697ac07dd5/applications/ChatGPT/examples/train_prompts.py#L115

taishiciR avatar Mar 06 '23 03:03 taishiciR

Hi @taishiciR you can use --pretrain <your pretrain model name/path> https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT/examples#inference-exampleafter-stage3

binmakeswell avatar Mar 07 '23 05:03 binmakeswell