Lei Niu comments

Repositories
Issues
Comments

Results 3 comments of


                                            Lei Niu

main: failed to load model from 'models/7B/ggml-model-q4_0.bin'

Mark. Same issue here. Will try previous version.

main: failed to load model from 'models/7B/ggml-model-q4_0.bin'

Might try to use this commit `66bc9af0f5c0a9ff386f20a8b2f351b47eed25a5` (the last published version before May 19th, reference https://www.reddit.com/r/LocalLLaMA/comments/13md90j/another_new_llamacpp_ggml_breaking_change/)

main: failed to load model from 'models/7B/ggml-model-q4_0.bin'

Resolved it by downloading `curl -o ggml-model-q4_0.bin -C - https://ipfs.io/ipfs/QmQ1bf2BTnYxq73MFJWu1B7bQ2UD6qG7D7YDCxhTndVkPC` please make sure it in the dictionary `models/7B` It works, I'm not sure about the source though, since it's from...