ggml icon indicating copy to clipboard operation
ggml copied to clipboard

Support for starcoder plus and starchat beta

Open aseok opened this issue 1 year ago • 4 comments

aseok avatar Jun 09 '23 13:06 aseok

This repo already has support for starcoder plus and starchat beta!

I quantised and uploaded them last night, using https://github.com/ggerganov/ggml/blob/master/examples/starcoder/convert-hf-to-ggml.py and https://github.com/ggerganov/ggml/blob/master/examples/starcoder/quantize.cpp :)

https://huggingface.co/TheBloke/starcoder-GGML https://huggingface.co/TheBloke/starcoderplus-GGML https://huggingface.co/TheBloke/starchat-beta-GGML

TheBloke avatar Jun 09 '23 13:06 TheBloke

Hello @TheBloke can you also help quantize https://huggingface.co/VMware/open-llama-7b-open-instruct?

m1chae1bx avatar Jun 09 '23 16:06 m1chae1bx

https://huggingface.co/TheBloke/open-llama-7b-open-instruct-GPTQ https://huggingface.co/TheBloke/open-llama-7b-open-instruct-GGML

GGML is still uploading as I write this - should all be there in another 15-20 mins or so.

TheBloke avatar Jun 09 '23 16:06 TheBloke

Wonderful! Thank you so much 🙏

m1chae1bx avatar Jun 09 '23 17:06 m1chae1bx