ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard
verified publisher icon hpcaitech

[BUG]: how can I run ChatGPT via inference.py which is at the example file?

Open hongkyunn opened this issue 2 years ago • 1 comments

🐛 Describe the bug

how can I run ChatGPT via inference.py which is at the example file?

Environment

No response

hongkyunn avatar Mar 16 '23 06:03 hongkyunn

Hi @hongkyunn You can refer to https://github.com/hpcaitech/ColossalAI/tree/main/applications/ChatGPT/examples#inference-exampleafter-stage3

binmakeswell avatar Mar 17 '23 09:03 binmakeswell

same question here. I had setuped the inference file on port 7070, but I am not sure which path and request format. I always get HTTP 422 error code

sharlec avatar Apr 01 '23 18:04 sharlec