binmakeswell comments

Results 359 comments of


                                            binmakeswell

[chatgpt] change critic input as state

Hi @wenjunyang Thank you very much for your contribution!

ModuleNotFoundError: No module named 'colossalai._C.cpu_adam'

Glad to hear it was resolved. Thanks.

[chatgpt] change critic input as state

We have updated a lot. Please check the latest code. This issue was closed due to inactivity. Thanks.

[BUG]: ZeRO无法使用预训练权重

This issue was closed due to inactivity. Thanks.

[doc] specified operating system requirement

Hi @FrankLeeeee I have added Linux support at the beginning. https://github.com/hpcaitech/ColossalAI#installation

[FEATURE]: Load the reward model in Stage 3 training script of ChatGPT

We have updated a lot. Please check the latest code. This issue was closed due to inactivity. Thanks.

The rm model which ppo train step3 requires ，but I can not find where to input this param in example ! pls help me out

Hi @taishiciR you can use --pretrain https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT/examples#inference-exampleafter-stage3

[BUG]: Failed to train the OPT-13b model due to OOM

Hi @hibayesian This path is an abbreviated tutorial prepared for specific activities and may not be maintained in real time. You should use the OPT example here https://github.com/hpcaitech/ColossalAI/tree/main/examples/language/opt Thanks.

[BUG]: Failed to train the OPT-13b model due to OOM

We have updated a lot. Please check the latest code. This issue was closed due to inactivity. Thanks.

[BUG]: failed to run /ColossalAI/examples/language/gpt/gemini

Glad to hear it was resolved. Thanks.