text-generation-inference icon indicating copy to clipboard operation
text-generation-inference copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

MPT support

Open generalsvr opened this issue 1 year ago • 8 comments

Model description

Can you add a new MPT model? This looks very promising, especially the ability to extend context length by up to 85K tokens.

Open source status

  • [X] The model implementation is available
  • [X] The model weights are available

Provide useful links for the implementation

https://github.com/mosaicml/llm-foundry

generalsvr avatar May 06 '23 01:05 generalsvr

Probably a related issue: https://github.com/huggingface/transformers/issues/23174

vvsotnikov avatar May 07 '23 18:05 vvsotnikov

any plan on supporting mosaicml/mpt-30b-instruct support

monuminu avatar Jun 23 '23 04:06 monuminu

I am also interested in deploying the mosaicml/mpt-30b-chat model. Would be really useful for the community! :pray:

ccasimiro88 avatar Jun 23 '23 10:06 ccasimiro88

Yes I am also interested in getting support for MPT models. I would love to assist in any way I can.

tim-a-davis avatar Jun 23 '23 14:06 tim-a-davis

+1

mantrakp04 avatar Jun 25 '23 23:06 mantrakp04

please🙏

alanxmay avatar Jun 26 '23 04:06 alanxmay

Yes I am also interested in getting support for MPT models. I would love to assist in any way I can.

Hey wanna work on the implementation then we can do a pr, add me on discord mantrakp- proud Logitech controller owner

mantrakp04 avatar Jun 26 '23 04:06 mantrakp04

https://github.com/huggingface/text-generation-inference/pull/514

Narsil avatar Jul 01 '23 10:07 Narsil