llm icon indicating copy to clipboard operation
llm copied to clipboard

Partially downloaded models

Open djswagerman opened this issue 9 months ago • 5 comments

When I download a model and somehow the download gets interrupted, when I try to use it, llm does not give any error message and responds with newlines. Is there any way I can delete or reload a partially download model?

djswagerman avatar Sep 12 '23 12:09 djswagerman

Same here.

mjavadhpour avatar Sep 19 '23 19:09 mjavadhpour

I think this line may help to delete the cached but crupted model:

https://github.com/nomic-ai/gpt4all/blob/0d1edaf0294b116d281996e18e027e35b55be1b1/gpt4all-bindings/python/gpt4all/gpt4all.py#L129

So removing the ~/.cache/gpt4all/<THE_MODEL_NAME> will remove the cached model so I can try to download the model again.

In my case prefixing command with SSL_CERT_DIR=/etc/ssl/certs successfully download the model:

SSL_CERT_DIR=/etc/ssl/certs llm -m ggml-all-MiniLM-L6-v2-f16 'Hello World!' 

I used llm-gpt4all plugin.

mjavadhpour avatar Sep 19 '23 20:09 mjavadhpour

Thanks, that helped!

djswagerman avatar Sep 21 '23 08:09 djswagerman

I tried to download the gpt4all models but got this error: ValueError: Request failed: HTTP 404 Not Found

doubleplusplus avatar Nov 17 '23 07:11 doubleplusplus

I'd just like a way to delete a model, period. :)

boldandbusted avatar May 15 '24 01:05 boldandbusted