dalai
dalai copied to clipboard
llama_model_load: loading model issue in Docker
llama_model_load: loading model from 'models/7B/ggml-model-q4_0.bin' - please wait ...
llama_model_load: invalid model file 'models/7B/ggml-model-q4_0.bin' (bad magic)
main: failed to load model from 'models/7B/ggml-model-q4_0.bin'
Can any one suggest please how to solve that issue
I'm using MacOS 13.4 encounter this issue too.
main: seed = 1686041591
llama_model_load: loading model from 'models/13B/ggml-model-q4_0.bin' - please wait ...
llama_model_load: invalid model file 'models/13B/ggml-model-q4_0.bin' (bad magic)
main: failed to load model from 'models/13B/ggml-model-q4_0.bin'
bash-3.2$ exit
Same thing on windows
Same on ubuntu
Facing same issue in docker container running in mac m1
that project is dead .... use llama.cpp or koboldcpp