llama Checking checksums - Could not parse check file 'checklist.chk' (2)

the error occurs when running the download.sh script. happened to me on MacOS, Apple Sillicon

Jul 18 '23 19:07 Anerco

Same error:

2023-07-18 19:57:12 (58.2 MB/s) - ‘./llama-2-70b-chat/checklist.chk’ saved [851880]

Checking checksums md5sum: checklist.chk: no properly formatted MD5 checksum lines found

Jul 18 '23 19:07 Mihir2

For additional context, the error occurs when running the download.sh script.

OS: MacOS 13.4.1

Jul 18 '23 20:07 cloudwolf516

Please write OS - Seems to be on MAC OS

Jul 18 '23 20:07 magedhelmy1

Got same error on Ubuntu

Jul 18 '23 20:07 diwasbhattarai

Quick workaround: remove this line from download.sh https://github.com/facebookresearch/llama/blob/cfc3fc8c1968d390eb830e65c63865e980873a06/download.sh#L56

Jul 18 '23 20:07 derwiki-gs

I am seeing this as well despite md5sum being installed properly in a conda env per description. Also, looking in the output in terminal, it seems 403 error despite being my first download only for 7B model

HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 16:10:01 ERROR 403: Forbidden.

Checking checksums
md5sum: checklist.chk: no properly formatted MD5 checksum lines found

Jul 18 '23 20:07 david-goodfellow

Requesting the link again, seems to be working with the new link as described here: https://github.com/facebookresearch/llama/issues/360#issuecomment-1640889338

Resolves the following error: 2023-07-18 19:57:12 (58.2 MB/s) - ‘./llama-2-70b-chat/checklist.chk’ saved [851880]

Checking checksums md5sum: checklist.chk: no properly formatted MD5 checksum lines found

Jul 18 '23 20:07 Mihir2

same as @david-goodfellow I am getting sporadic 403s

Jul 18 '23 20:07 derwiki-gs

Also try to exit any VPN you might have turned on. That solved it for me!

Jul 18 '23 20:07 pblan

Quick workaround: remove this line from download.sh

https://github.com/facebookresearch/llama/blob/cfc3fc8c1968d390eb830e65c63865e980873a06/download.sh#L56

somehow I feel this will just lead to hard to debug issues down the line 🤔

Jul 18 '23 20:07 david-goodfellow

requesting a new link did not work for me

Jul 18 '23 20:07 owquresh

Similar, but I get unsupported browser and no valid checksums. Looks like it copies the HTTP response into the place of checklist.chk since it doesn't get the checksum file itself. Commenting the line doesn't work since it still fails due to unsupported browser error, whatever that means in this context. Running Ubuntu.

Connecting to l.facebook.com (l.facebook.com)|2a03:2880:f158:84:face:b00c:0:14c9|:443... connected. HTTP request sent, awaiting response... 302 Found Location: https://www.facebook.com/unsupportedbrowser [following] --2023-07-18 21:50:16-- https://www.facebook.com/unsupportedbrowser

Jul 18 '23 21:07 Levinin

Check that you've copied the URL in the email, and not the href value, i.e. what you get when you right-click on a link and select "Copy Link."

If the value you've pasted into download.sh begins with https://l.facebook.com instead of https://download.llamameta.net then you've copied it wrong :)

Jul 18 '23 21:07 tbbuck

Not connected to VPN. Re-requested link, but second link didn't work, either. 403s for every request. Tried on Ubuntu 20.04 and Ubuntu on WSL.

Jul 18 '23 22:07 gooselord-0

Same issue. Not working with new link too.

Jul 18 '23 22:07 DamithDR

Check that you've copied the URL in the email, and not the href value, i.e. what you get when you right-click on a link and select "Copy Link."

If the value you've pasted into download.sh begins with https://l.facebook.com instead of https://download.llamameta.net then you've copied it wrong :)

This solved it for me. Thanks

Jul 19 '23 02:07 aptl26-prev2

Check that you've copied the URL in the email, and not the href value, i.e. what you get when you right-click on a link and select "Copy Link."

If the value you've pasted into download.sh begins with https://l.facebook.com instead of https://download.llamameta.net then you've copied it wrong :)

Rookie error, thank you!

Jul 19 '23 06:07 Levinin

Hi everyone, we fixed some issues with the download links yesterday - resetting your local directory and requesting a new link is the best way to start over unless you've already verified checksums and know exactly which files you need. Make sure you're requesting a fresh link, copying the actual text of the link (download.llamameta.net), and starting from a fresh local directory. Sorry for the issues yesterday!

Jul 19 '23 13:07 chrismarra

~~Thanks for that, perhaps a download.sh file for OS: mac & linux also?~~ After the above update, the download.sh is working on MAC OS.

Jul 19 '23 13:07 magedhelmy1

@chrismarra For some reason I still get the same issue after re-cloning and trying with a new link. (full fresh start)

Jul 19 '23 13:07 DamithDR

@chrismarra I too still have the 403 issue, despite a fresh local directory and a fresh+correct download hyperlink. Tried on two systems (Ubuntu 20.04 on both).

Starlink is my ISP, if by any chance CGNAT could be causing these issues.

Jul 19 '23 14:07 gooselord-0

It's worth mentioning you need to read the question it asks.

It says

Enter the URL from email:

If you are on auto-pilot you might read it as

Enter blah blah email:

You need to paste in the URL that starts

https://download.llamameta.net/...)

Hope that helps people struggling

Jul 19 '23 15:07 digiguru

It's worth mentioning you need to read the question it asks.

It says
Enter the URL from email: 
If you are on auto-pilot you might read it as
Enter blah blah email:
You need to paste in the URL that starts
https://download.llamameta.net/...)
Hope that helps people struggling

A number of us aren't on auto-pilot and are still having issues despite copying the correct link.

Jul 19 '23 15:07 gooselord-0

Try to define PRESIGNED_URL and MODEL_SIZE in ./download.sh as:

PRESIGNED_URL="Your URL" MODEL_SIZE="The Model Size You Want"

instead of read -p "Enter the URL from email: " PRESIGNED_URL

Jul 19 '23 23:07 m5a0r7

It's worth mentioning you need to read the question it asks.

It says
Enter the URL from email: 
If you are on auto-pilot you might read it as
Enter blah blah email:
You need to paste in the URL that starts
https://download.llamameta.net/...)
Hope that helps people struggling

This was actually helpful as I was on said "autopilot" lol. Entered the URL instead of continually being an idiot and entering my email.

Don't understand why people are getting upset. Thanks man.

Jul 20 '23 15:07 ShaunMoore

It's worth mentioning you need to read the question it asks. It says
Enter the URL from email: 
If you are on auto-pilot you might read it as
Enter blah blah email:
You need to paste in the URL that starts
https://download.llamameta.net/...)
Hope that helps people struggling
A number of us aren't on auto-pilot and are still having issues despite copying the correct link.

Actually, even after I re-cloned the repository and used the URL beginning with https://download.llamameta.net/...), I still received a '403: Forbidden' message.

Aug 15 '23 06:08 steveoon

you can download the block version here https://huggingface.co/TheBloke/Llama-2-70B-chat-GPTQ or any other https://huggingface.co/TheBloke/

Aug 19 '23 18:08 uthpala1000

Looks like the version of md5sum doesn't support the "-c" switch. If you edit this line and remove the switch md5 works correctly.

From: (cd ${TARGET_FOLDER}"/${MODEL_PATH}" && md5sum -c checklist.chk) To: (cd ${TARGET_FOLDER}"/${MODEL_PATH}" && md5sum checklist.chk)

Sep 18 '23 12:09 se7enack

I had the same issue. Thanks for all the tips. What I did now fixed my problems.

removed the historical files tokenizer.model tokenizer_checklist.chk
requested a new link, click & open it in a browser and paste the link to the command line when prompted It is working for me now

Oct 11 '23 19:10 chengh99

I hardcoded the TARGET_FOLDER(where you want your model be downloaded) in the download.sh and rerun the script then it started downloading

Feb 28 '24 20:02 davidgao7