FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Add support of Phoenix, a multilingual instruction-following language model.

Open GeneZC opened this issue 2 years ago • 0 comments
trafficstars

Phoenix is a multilingual instruction-following language model which aims to democratize ChatGPT across languages.

It has achieved competitive performance with ChatGLM and Wenxin on Chinese following the evaluation protocol of Vicuna.

We here add support of Phoenix for the cli inference and potentially for the arena. Since Phoenix is tuned from Bloom, we believe the integration is rather straightforward.

You guys could try it via:

python3 -m fastchat.serve.cli --model-path FreedomIntelligence/phoenix-inst-chat-7b

And we have verified the integration on an Nvidia A100-40G.

GeneZC avatar May 07 '23 08:05 GeneZC