BitNet
BitNet copied to clipboard
ggml-model-i2_s.gguf gives magic file error when adding to Ollama
I have successfully implemented BitNet but when I am trying to add it to Ollama with "ggml-model-i2_s.gguf" it fails:
ollama create bitnet -f Modelfile
transferring model data 100%
Error: invalid file magic
I can use the other gguf file "ggml-model-f32.gguf" for this, but first it take long to transfer to Ollama and second, it become very slow, size of 32G.
Is there any remedy for this?