dalai icon indicating copy to clipboard operation
dalai copied to clipboard

llama_model_load: loading model issue in Docker

Open nationallokmatparty opened this issue 1 year ago • 5 comments

llama_model_load: loading model from 'models/7B/ggml-model-q4_0.bin' - please wait ...

llama_model_load: invalid model file 'models/7B/ggml-model-q4_0.bin' (bad magic)

main: failed to load model from 'models/7B/ggml-model-q4_0.bin'

Can any one suggest please how to solve that issue

nationallokmatparty avatar Jun 03 '23 14:06 nationallokmatparty

I'm using MacOS 13.4 encounter this issue too.

main: seed = 1686041591
llama_model_load: loading model from 'models/13B/ggml-model-q4_0.bin' - please wait ...
llama_model_load: invalid model file 'models/13B/ggml-model-q4_0.bin' (bad magic)
main: failed to load model from 'models/13B/ggml-model-q4_0.bin'
bash-3.2$ exit

haohsiangc avatar Jun 06 '23 08:06 haohsiangc

Same thing on windows

akapulka avatar Jun 06 '23 09:06 akapulka

Same on ubuntu

pedrooct avatar Jun 13 '23 19:06 pedrooct

Facing same issue in docker container running in mac m1

hayatbehlim avatar Jun 13 '23 21:06 hayatbehlim

that project is dead .... use llama.cpp or koboldcpp

mirek190 avatar Jun 17 '23 16:06 mirek190