bloomz.cpp icon indicating copy to clipboard operation
bloomz.cpp copied to clipboard

Is there any plan for mT0 model support?

Open qdwang opened this issue 1 year ago • 1 comments

BLOOMZ and mT0 models are related, and mT0-13B performs better than BLOOMZ-176B in some cases.

The mT0-13B will be a killer model for normal user devices after a GPTQ-4bit quantization.

Hope the model can be supported.

qdwang avatar Mar 24 '23 11:03 qdwang

Hopefully soon https://github.com/ggerganov/ggml/pull/12 👀

NouamaneTazi avatar Mar 28 '23 09:03 NouamaneTazi