download.sh returns 403 forbidden error

[DrewWalkup]

trafficstars

What's Happening When attempting to download the 70B-chat model using download.sh, the model itself returns a 403 forbidden code.

Traceback *Note the the policy has been removed to maintain security.

Downloading llama-2-70b-chat
--2023-07-18 14:56:00--  https://download.llamameta.net/llama-2-70b-chat/consolidated.00.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.110, 18.155.202.78, 18.155.202.88, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.110|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:00 ERROR 403: Forbidden.

--2023-07-18 14:56:00--  https://download.llamameta.net/llama-2-70b-chat/consolidated.01.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.78, 18.155.202.110, 18.155.202.51, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.78|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:00 ERROR 403: Forbidden.

--2023-07-18 14:56:00--  https://download.llamameta.net/llama-2-70b-chat/consolidated.02.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.51, 18.155.202.78, 18.155.202.88, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.51|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:00 ERROR 403: Forbidden.

--2023-07-18 14:56:00--  https://download.llamameta.net/llama-2-70b-chat/consolidated.03.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.110, 18.155.202.78, 18.155.202.51, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.110|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/consolidated.04.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.51, 18.155.202.88, 18.155.202.110, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.51|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/consolidated.05.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.88, 18.155.202.78, 18.155.202.51, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.88|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/consolidated.06.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.88, 18.155.202.110, 18.155.202.78, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.88|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/consolidated.07.pth?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.78, 18.155.202.51, 18.155.202.110, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.78|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/params.json?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.110, 18.155.202.88, 18.155.202.51, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.110|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:01 ERROR 403: Forbidden.

--2023-07-18 14:56:01--  https://download.llamameta.net/llama-2-70b-chat/checklist.chk?Policy=e...
Resolving download.llamameta.net (download.llamameta.net)... 18.155.202.51, 18.155.202.88, 18.155.202.78, ...
Connecting to download.llamameta.net (download.llamameta.net)|18.155.202.51|:443... connected.
HTTP request sent, awaiting response... 403 Forbidden
2023-07-18 14:56:02 ERROR 403: Forbidden.

Checking checksums
md5sum: checklist.chk: no properly formatted MD5 checksum lines found

Steps to Reproduce git clone https://github.com/facebookresearch/llama.git cd to_llama_directory source download.sh enter URL enter '70B-chat' as model to download

[blevlabs]

Just tried 'source' with my download.sh script and got the same issue.

[rolandtannous]

yes same problem here

[alexanderfrey]

same here

[rwade42]

Same :(

[ai8hyf]

same

[wtfbbqhax]

same

[zitterbewegung]

I am also getting errors saying 403 forbidden.

[realhaik]

Yes, the download URL that is sent in the email returns 403

<Error>
<Code>AccessDenied</Code>
<Message>Access Denied</Message>
<RequestId>SKYPWV0JXM2WGX0E</RequestId>
<HostId>/FrUedRqzYAjkmRLenU0MYosC5qR+q27LR2WWh09+NNqSXnGXhJTP2V8Y8a1aryGUVFenNLbLBI=</HostId>
</Error>

[tensorboy]

Same issues

[efraisse]

checkout @MIBlue119's comment under issue #370, it worked for me, he said: """ @thewilltejeda / @joshvfleming Try to a. remove the llama directory b. reclone the repo c. resent the request to https://ai.meta.com/resources/models-and-libraries/llama-downloads/ again to get the new link d. cd llama e. chmod 755 download.sh f. copy the url from the newest email to the ./download.sh """

[rolandtannous]

already sent another request.. didn't get a link yet

[jxy]

Downloading LICENSE, USE_POLICY.md, tokenizer.model, and tokenizer_checklist.chk are fine, but downloading any model specific files gives 403 forbidden.

[khushpatelmd]

facing 403 forbidden error. Requested a link again and had the same issue.

[bdambrosio]

me too. sigh

[pyamin1878]

same same same

[pyamin1878]

It downloaded 5 items, and then restricted from downloading models.

[sivang]

getting this to all model downloads...

Also getting this, it'd be nice if someone from Meta could chip in and provide some insight to this. thanks

[jpfyoder]

Same issue here.

[MatthewNicastro]

I did what was suggested by @efraisse and it semi worked. The non-chat models seem to fail, but the chat ones work just fine. I think this might be a server issue

[keceli]

Make sure the URL text you paste starts with: https://download.llamameta.net/. If it starts with: https://l.facebook.com/ it doesn't work.

[shi-kejian]

I fixed it by:

1. Only manually copy (ctrl+c or cmd+c) the URL text in the email. Don't do "copy link"
2. if 403 still occur, request a link again. I got an immediate 2nd approval.

It seems my 2nd approval link works 🎉, use it asap but the first one doesn't.

Also see issue #350 and #351

[taf2]

@shi-kejian this didn't work for me... :(

chmod a+x ./download.sh
./download.sh

I'm 90% certain they have an encoding issue in the link they send out... so based on the hash they generate some people will get a broken link some maybe get a good link.

[faizansid77]

I am also facing the same issue

[sumeetshirgure]

Same issue

[faizansid77]

Requesting another link and downloading models one-by-one works for me

[lallousx86]

Same problem. I managed to download the non chat models, no problems. All of them. The chat models give an error.

Nothing but problems downloading today. On my second requested link and trying to get this silly thing to work.

What's funny is that Meta engineers think we are babies: "Oh, maybe you paste the wrong email link", "Oh, maybe you also copied the 'Select' word on the second line", "Oh, don't use the redirect link" ...

Meta, fix your stuff....

And thanks for your contribution.

[akashocx17]

Same stuff!! requesting again

[blevlabs]

checkout @MIBlue119's comment under issue #370, it worked for me, he said: """ @thewilltejeda / @joshvfleming Try to a. remove the llama directory b. reclone the repo c. resent the request to https://ai.meta.com/resources/models-and-libraries/llama-downloads/ again to get the new link d. cd llama e. chmod 755 download.sh f. copy the url from the newest email to the ./download.sh """

I got the new URL from a second request and followed the steps above from another commenter and now I can successfully download the models

[taf2]

I can report getting a new link and starting by just downloading '13b' seems to work. Unsure if the 70b-chat will work

Interesting in my output for 13b i see one request 403'd and one is downloading... this could just be ratelimits on their servers preventing downloads?

https://download.llamameta.net/llama-2-13b/consolidated.00.pth -> 403'ed while https://download.llamameta.net/llama-2-13b/consolidated.01.pth -> is downloading fine.

Here's the final output:

Checking checksums
consolidated.00.pth: FAILED
consolidated.01.pth: OK
params.json: OK
md5sum: WARNING: 1 computed checksum did NOT match

running a second time and everything fails with just:

Checking checksums
md5sum: checklist.chk: no properly formatted checksum lines found

[blevlabs]

I can report getting a new link and starting by just downloading '13b' seems to work. Unsure if the 70b-chat will work

Interesting in my output for 13b i see one request 403'd and one is downloading... this could just be ratelimits on their servers preventing downloads?

https://download.llamameta.net/llama-2-13b/consolidated.00.pth -> 403'ed while

https://download.llamameta.net/llama-2-13b/consolidated.01.pth -> is downloading fine.

Here's the final output:

Checking checksums

consolidated.00.pth: FAILED

consolidated.01.pth: OK

params.json: OK

md5sum: WARNING: 1 computed checksum did NOT match

running a second time and everything fails with just:

Checking checksums

md5sum: checklist.chk: no properly formatted checksum lines found

I am getting the same - its getting a lot of 403s but its downloading something... Hopefully the models wont just be partially downloaded and they will be functional.