FastChat icon indicating copy to clipboard operation
FastChat copied to clipboard

Add support for MPT-7B.

Open digisomni opened this issue 2 years ago • 1 comments

https://huggingface.co/mosaicml/mpt-7b-storywriter

The model appears to be a great alternative to LLaMA from surface observations, particularly for commercial use. I expect many groups to build upon this foundation going forward if it does hold up.

Can someone perhaps look into adding support for this model?

digisomni avatar May 07 '23 22:05 digisomni

Contribution is welcome and you can see this PR (https://github.com/lm-sys/FastChat/pull/1019) for example

merrymercy avatar May 08 '23 08:05 merrymercy

https://huggingface.co/mosaicml/mpt-7b-storywriter

To be clear: In https://github.com/lm-sys/FastChat/pull/1111 the mpt-7b-chat model was added, not the untuned mpt-7b or the mpt-7b-instruct or mpt-7b-storywriter tuned models.

EwoutH avatar May 11 '23 19:05 EwoutH