ColossalAI
ColossalAI copied to clipboard
[DOC]: how to infer by chatgpt models
📚 The doc issue
Hello, authors and developers,I have a problem with chatgpt. I train my model with single GPU, I want to know how to infer or predict the chatgpt model trained based on scripts such as examples/train_prompt.py, without related scripts or some dependencies。Thanks for your reply.
meet the same issue. anyone can write a doc or any blog to show how to use colossalai to infer
Hi @Muzzypepper and @hurun Thanks for the feedback, we will provide it soon.
Please let me know if a doc is published. Thanks
Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑🤝🧑👫🧑🏿🤝🧑🏻👩🏾🤝👨🏿👬🏿
Please let me know if a doc is published. Thanks