gpt4all icon indicating copy to clipboard operation
gpt4all copied to clipboard

Failing to download models

Open DMTarmey opened this issue 1 year ago • 6 comments

Hi i just installed the windows installation application and trying to download a model, but it just doesn't seem to finish any download.

DMTarmey avatar May 02 '23 09:05 DMTarmey

same here. got the error:

ERROR: Download error MD5SUM did not match: "65023f2b4ad4f10d75a0c1c019cdea6f" != "6cb4ee297537c9133bddab9692879de0" for "ggml-stable-vicuna-13B.q4_2.bin"

tried other model. same.

subversion23 avatar May 02 '23 22:05 subversion23

Same on mac v2.3.0

I wait for download to finish then poof! nothing is in the folder. I just wasted tons of bandwidth with my ISP.

image

Korayem avatar May 05 '23 07:05 Korayem

Is there a list of download links to all the models, so we can manually download?

Woisek avatar May 18 '23 23:05 Woisek

@Woisek

Manually download:

  1. It is recommended to install JSON Formatter for a better viewing experience. This step is optional.

  2. Open https://gpt4all.io/models/models.json. Once opened, you will see all the models.

  3. Taking the model mpt-7b-chat as an example, you can find its corresponding filename on the page you just opened. The content of filename is ggml-mpt-7b-chat.bin. Copy this filename. image

  4. Concatenate the download link. The format is https://gpt4all.io/models/ + filename. Using the example model above, the resulting link would be https://gpt4all.io/models/ggml-mpt-7b-chat.bin.

  5. Use an appropriate download tool (a browser can also be used) to download the obtained link.

  6. Move the downloaded ggml-mpt-7b-chat.bin file to the model storage directory of GPT4All. You can find the directory path in the model download dialog of GPT4All. For example, on macOS, it would be /Users/someone/Library/Application Support/nomic.ai/GTP4All. image

  7. Quit and reopen GPT4All.


Additionally, it is recommended to verify whether the file is downloaded completely. Use any tool capable of calculating the MD5 checksum of a file to calculate the MD5 checksum of the ggml-mpt-7b-chat.bin file. Compare this checksum with the md5sum listed on the models.json page. If they do not match, it indicates that the file is incomplete, which may result in the model not functioning properly. image

ansonhorse avatar May 19 '23 03:05 ansonhorse

Perfect! Works like a charm! Thanks! 😊

Woisek avatar May 19 '23 07:05 Woisek

Works!

sunil-dhaka avatar May 26 '23 04:05 sunil-dhaka

thank you so much

StillMelo avatar Jun 22 '23 22:06 StillMelo

I concatenated the URL to https://gpt4all.io/models/ggml-model-gpt4all-falcon-q4_0.bin and i tried other models like this one https://gpt4all.io/models/nous-hermes-13b.ggmlv3.q4_0.bin , but i'm still getting this error. Do i need to download all of the models individually or do i just use the link you made "https://gpt4all.io/models/ggml-mpt-7b-chat.bin" to use all of them?

Error 404 This object could not be viewed You are not authorized to view this object

This object does not exist or is not publicly accessible at this URL. Check the URL of the object that you're looking for or contact the owner to enable Public access.

Is this your bucket?

Learn how to enable Public Access

Also the model i downloaded of "https://gpt4all.io/models/ggml-mpt-7b-chat.bin" responses are cut off and incomplete from the chatgpt responses.. so i wouldn't recommend anyone using this one.

FYI chatgpt from openai is down at the moment.. maybe thats causing my current issue?

johntsunami avatar Jul 11 '23 14:07 johntsunami

Found the fix.. Just download the bin file from the url from the Json file. Like this one. "url": "https://huggingface.co/TheBloke/Nous-Hermes-13B-GGML/resolve/main/nous-hermes-13b.ggmlv3.q4_0.bin", Screenshot 2023-07-11 080252

johntsunami avatar Jul 11 '23 15:07 johntsunami

Great, thank you very much for your reply.

---Original--- From: "John @.> Date: Tue, Jul 11, 2023 23:07 PM To: @.>; Cc: @.@.>; Subject: Re: [nomic-ai/gpt4all] Failing to download models (Issue #477)

Found the fix.. Just download the bin file from the url from the Json file. Like this one. "url": "https://huggingface.co/TheBloke/Nous-Hermes-13B-GGML/resolve/main/nous-hermes-13b.ggmlv3.q4_0.bin",

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you are subscribed to this thread.Message ID: @.***>

3204853406 avatar Jul 11 '23 15:07 3204853406

@johntsunami I had that issue with the Falcon model as well – here is another source for downloading it: https://huggingface.co/nomic-ai/gpt4all-falcon-ggml/tree/main From there you need to follow step 6 and 7 as described by @ansonhorse above at https://github.com/nomic-ai/gpt4all/issues/477#issuecomment-1553945164 :)

EDIT: Nevermind my comment – had an outdated version of this issue open for some reason. Good that you found a fix too!

jancborchardt avatar Jul 12 '23 14:07 jancborchardt

If it helps anyone, as mentioned here, I could solve it by using Turbo Download Manager Firefox extension.

nav9 avatar Jul 20 '23 15:07 nav9

I've been experiencing the same problem. I downloaded Gpt4All today, tried to use its interface to download several models. They all failed at the very end. Sometimes they mentioned errors in the hash, sometimes they didn't.

Seems to me there's some problem either in Gpt4All or in the API that provides the models. I would suggest adding an override to avoid evaluating the checksum, at least until the underlying issue is solved.

filippopossenti avatar Jul 20 '23 18:07 filippopossenti

After putting the downloaded .bin file for GPT4All Falcon into /Users/namehere/Library/Application Support/nomic.ai/GPT4All/ (on macOS 12.6.6) and then relaunching GPT4All, it fails to detect the model there and simply doesn't work. Any ideas?

WGrav01 avatar Oct 31 '23 01:10 WGrav01

After putting the downloaded .bin file

Assuming you are using GPT4All v2.5.0+, you need to download a .gguf file. GGML (.bin) files are no longer supported.

cebtenzzre avatar Oct 31 '23 02:10 cebtenzzre

After putting the downloaded .bin file

Assuming you are using GPT4All v2.5.0+, you need to download a .gguf file. GGML (.bin) files are no longer supported.

That makes sense, (I am using v3.5.2) but the json file above doesn't have any .gguf files. Where do I get those?

WGrav01 avatar Nov 01 '23 17:11 WGrav01

the json file above doesn't have any .gguf files. Where do I get those?

http://gpt4all.io/models/models2.json

cebtenzzre avatar Nov 01 '23 17:11 cebtenzzre