ggml
ggml copied to clipboard
Support for starcoder plus and starchat beta
This repo already has support for starcoder plus and starchat beta!
I quantised and uploaded them last night, using https://github.com/ggerganov/ggml/blob/master/examples/starcoder/convert-hf-to-ggml.py and https://github.com/ggerganov/ggml/blob/master/examples/starcoder/quantize.cpp :)
https://huggingface.co/TheBloke/starcoder-GGML https://huggingface.co/TheBloke/starcoderplus-GGML https://huggingface.co/TheBloke/starchat-beta-GGML
Hello @TheBloke can you also help quantize https://huggingface.co/VMware/open-llama-7b-open-instruct?
https://huggingface.co/TheBloke/open-llama-7b-open-instruct-GPTQ https://huggingface.co/TheBloke/open-llama-7b-open-instruct-GGML
GGML is still uploading as I write this - should all be there in another 15-20 mins or so.
Wonderful! Thank you so much 🙏