BitNet icon indicating copy to clipboard operation
BitNet copied to clipboard

ggml-model-i2_s.gguf gives magic file error when adding to Ollama

Open geoej opened this issue 3 months ago • 0 comments

I have successfully implemented BitNet but when I am trying to add it to Ollama with "ggml-model-i2_s.gguf" it fails:

ollama create bitnet -f Modelfile
transferring model data 100% 
Error: invalid file magic

I can use the other gguf file "ggml-model-f32.gguf" for this, but first it take long to transfer to Ollama and second, it become very slow, size of 32G.

Is there any remedy for this?

geoej avatar Oct 31 '24 20:10 geoej