[DOC]: Step3 in Basic Usage for Build an online OPT service using Colossal-AI in 5 minutes is not clear

Open grantchenhuarong opened this issue 2 years ago • 1 comments

📚 The doc issue

Just like the issue title,when I read it ,I can not figure out how to implement it through the guide. Lack of files such as server.sh and opt_config.py, which was mentioned about.

Need some clear helps to deploy this inference，pls help and thank you.

Feb 21 '23 10:02 grantchenhuarong

Sorry for any confusion caused. The guide was obsolete. We will seek to update it soon!

Please take a look at this instruction and follow along. It would work fine!

Feb 21 '23 18:02 JThh

Thanks for your feedback. Sorry for this issue, we are a small team and have to focus on development currently. Maybe we will update the doc maybe next month. This issue was closed due to inactivity. Thanks.

Apr 20 '23 07:04 binmakeswell