ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[DOC]: how to infer by chatgpt models

Open Muzzypepper opened this issue 2 years ago • 4 comments

📚 The doc issue

Hello, authors and developers,I have a problem with chatgpt. I train my model with single GPU, I want to know how to infer or predict the chatgpt model trained based on scripts such as examples/train_prompt.py, without related scripts or some dependencies。Thanks for your reply.

Muzzypepper avatar Feb 22 '23 06:02 Muzzypepper

meet the same issue. anyone can write a doc or any blog to show how to use colossalai to infer

hurun avatar Feb 22 '23 10:02 hurun

Hi @Muzzypepper and @hurun Thanks for the feedback, we will provide it soon.

binmakeswell avatar Feb 28 '23 08:02 binmakeswell

Please let me know if a doc is published. Thanks

LeiJiang1 avatar Feb 28 '23 16:02 LeiJiang1

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


Please let me know if a doc is published. Thanks

Issues-translate-bot avatar Feb 28 '23 16:02 Issues-translate-bot