rust-bert icon indicating copy to clipboard operation
rust-bert copied to clipboard

Published 20 hours ago • verified publisher icon guillaume-be

Support mpt-7b

Open Mnwa opened this issue 2 years ago • 3 comments

Hey! It will be great to support the new MosaicPretrainedTransformer? https://huggingface.co/mosaicml/mpt-7b

Mnwa avatar May 11 '23 10:05 Mnwa

Big +1 on this one!

skyne98 avatar May 13 '23 05:05 skyne98

https://github.com/rustformers/llm actually got support for MPT recently. It’s not published on crates.io yet but you can use the main branch straight from Git.

dimfeld avatar May 25 '23 05:05 dimfeld

It would indeed be a great addition - if someone has the bandwidth and interest to work on an implementation let me know, happy to help out. I am lacking the immediate bandwidth to look into it right away but may get to it in the next few weeks - let me know if you get started.

guillaume-be avatar Jul 11 '23 17:07 guillaume-be