FastChat
FastChat copied to clipboard
Add support of Phoenix, a multilingual instruction-following language model.
trafficstars
Phoenix is a multilingual instruction-following language model which aims to democratize ChatGPT across languages.
It has achieved competitive performance with ChatGLM and Wenxin on Chinese following the evaluation protocol of Vicuna.
We here add support of Phoenix for the cli inference and potentially for the arena. Since Phoenix is tuned from Bloom, we believe the integration is rather straightforward.
You guys could try it via:
python3 -m fastchat.serve.cli --model-path FreedomIntelligence/phoenix-inst-chat-7b
And we have verified the integration on an Nvidia A100-40G.