aws-serverless-workshops icon indicating copy to clipboard operation
aws-serverless-workshops copied to clipboard

Copying the wildrydes files from s3 fails with access denied

Open daiscog opened this issue 4 years ago • 35 comments

Following the "build a serverless web app" tutorial, and hit two issues in the Copy the files from S3 step in Module 1 - Static Web Hosting with Continuous Deployment.

Firstly, the pre-requisites for the tutorial didn't mention the need to install the aws cli, so I had to go and figure that out (more an annoyance than a blocker, as a quick Google for "aws cli" sorted that).

Then once the CLI is installed, running the aws s3 cp s3://wildrydes-us-east-1/WebApplication/1_StaticWebHosting/website ./ --recursive command as instructed results in this error:

fatal error: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied

I assume the target S3 bucket is no longer publicly available...

daiscog avatar Sep 23 '20 18:09 daiscog

Hi @daiscog - I had the same problem. I resolved it by granting the IAM user that was doing the copy the AmazonS3ReadOnlyAccess policy - this gave the user permission to read from S3.

mtreby avatar May 18 '21 16:05 mtreby

Hi @daiscog - I had the same problem. I resolved it by granting the IAM user that was doing the copy the AmazonS3ReadOnlyAccess policy - this gave the user permission to read from S3.

Worked for me as well! Thanks

SuperGx avatar Jul 29 '21 09:07 SuperGx

Adding AmazonS3ReadOnlyAccess policy did not work for me

phmohan avatar Sep 15 '21 04:09 phmohan

Adding AmazonS3ReadOnlyAccess policy did not work for me

@phmohan I had to wait a few minutes after granting the IAM user AmazonS3ReadOnlyAccess before it took effect and I was able to copy the files from the S3 bucket.

skilletspecial avatar Sep 16 '21 18:09 skilletspecial

how much wait is required? AmazonS3ReadOnlyAccess permission is not working for me as well.

ranaalisaeed avatar Dec 16 '21 20:12 ranaalisaeed

Ok so the solution is a few things:

  1. For the IAM user, ensure you added the Access key ID and secret in your environment. You can check it on cat ~/.aws/credentials
  1. For the IAM user, ensure you have AmazonS3ReadOnlyAccess permission

ranaalisaeed avatar Dec 16 '21 21:12 ranaalisaeed

@mtreby worked for me thanks!

Delali97 avatar Nov 02 '22 17:11 Delali97

@ranaalisaeed , I have done no2, and it did not work, how can I go about doing no1

Ok so the solution is a few things:

  1. For the IAM user, ensure you added the Access key ID and secret in your environment. You can check it on cat ~/.aws/credentials

  2. For the IAM user, ensure you have AmazonS3ReadOnlyAccess permission

tordue avatar Nov 08 '22 18:11 tordue

I faced same issue and resolved it using IAM. My IAM policies had S3 full access, Cloudshell full access(Since I used AWS CLI)

jay1299 avatar Dec 08 '22 13:12 jay1299

Can anyone help me with the below error for the above tutorial: I have given s3fullaccess as well. what does it mean when it says token expired.

aws s3 cp s3://wildrydes-us-east-1/WebApplication/1_StaticWebHosting/website ./ --recursive fatal error: An error occurred (ExpiredToken) when calling the ListObjectsV2 operation: The provided token has expired.

aditya-grk avatar Feb 25 '23 14:02 aditya-grk

Thanks that work for me. @aditya-grk try to generate new access keys in the security credentials of your IAM user.

pkOO5 avatar Mar 08 '23 14:03 pkOO5

Hi @daiscog - I had the same problem. I resolved it by granting the IAM user that was doing the copy the AmazonS3ReadOnlyAccess policy - this gave the user permission to read from S3.

I had the same issue. It worked for me by adding this Policy. Great job AWS.. absolutely no context left in the description about that.

Smith-Steve avatar Sep 26 '23 22:09 Smith-Steve

@mtreby - worked for me! Thanks

lavenaj avatar Jan 25 '24 14:01 lavenaj

I've found the "same" tutorial at https://webapp.serverlessworkshops.io/ is more up-to-date. It also pulls from GitHub.

dwittle avatar Feb 08 '24 23:02 dwittle

After doing the following, i still have the same issue. Anyone have any ideas?

  • Add AmazonS3ReadOnlyAccess
  • Make sure ~/.aws/credentials and ~/.aws/config have the correct content
  • To verify my setup, i created a public s3 bucket, and i am able to download files from it via CLI.

My AmazonS3ReadOnlyAccess looks like this:

Screenshot from 2024-02-12 09-45-51

xuesen-li avatar Feb 12 '24 17:02 xuesen-li

Following the "build a serverless web app" tutorial, and hit two issues in the Copy the files from S3 step in Module 1 - Static Web Hosting with Continuous Deployment.

Firstly, the pre-requisites for the tutorial didn't mention the need to install the aws cli, so I had to go and figure that out (more an annoyance than a blocker, as a quick Google for "aws cli" sorted that).

Then once the CLI is installed, running the aws s3 cp s3://wildrydes-us-east-1/WebApplication/1_StaticWebHosting/website ./ --recursive command as instructed results in this error:

fatal error: An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied

I assume the target S3 bucket is no longer publicly available...

as at today 13th February 2024, I still have this issue

blossom2016 avatar Feb 13 '24 22:02 blossom2016

the problem is that the s3 bucketv isn't publicly accessible anymore. in order to find it check it here aws s3 cp s3://ttt-wildrydes/wildrydes-site ./ --recursive

blossom2016 avatar Feb 14 '24 00:02 blossom2016

i too got the same access denied error i have granted administrator access.

Adhikesavan12 avatar Feb 14 '24 14:02 Adhikesavan12

the problem is that the s3 bucketv isn't publicly accessible anymore. in order to find it check it here aws s3 cp s3://ttt-wildrydes/wildrydes-site ./ --recursive

AccessDenied error is gone but now when I git push, here's the new error:

fatal: repository 'https://git-codecommit.us-west-2.amazonaws.com/v1/repos/wildrydes-site/' not found

create a new repo and start all over again , with the git clone etc process. Also make sure you are in the us-west-2 region this is very important . I had to change my region and created the repo in this region

blossom2016 avatar Feb 15 '24 23:02 blossom2016

the problem is that the s3 bucketv isn't publicly accessible anymore. in order to find it check it here aws s3 cp s3://ttt-wildrydes/wildrydes-site ./ --recursive

AccessDenied error is gone but now when I git push, here's the new error: fatal: repository 'https://git-codecommit.us-west-2.amazonaws.com/v1/repos/wildrydes-site/' not found

create a new repo and start all over again , with the git clone etc process. Also make sure you are in the us-west-2 region this is very important . I had to change my region and created the repo in this region

Tried changing region to us-west-2 and doing all over again but didn't help. When I git push to CodeCommit repository, after it asks credentials, I get this error again:

fatal: repository 'https://git-codecommit.us-west-2.amazonaws.com/v1/repos/wildrydes-site/' not found

did you name the repo you created in the us-west-2 region " wildrydes-site " when I had similar issues, I deleted the repos there, started again and named my repo "wildrydes-site" not " wildrydes-site2 "

blossom2016 avatar Feb 17 '24 12:02 blossom2016

C:\Users\compu\wildrydes-site>git add . error: 'wildrydes-site/' does not have a commit checked out fatal: adding files failed WHAT DO I DO NOWW

lakshiuuu avatar Feb 24 '24 11:02 lakshiuuu

ws s3 cp s3://ttt-wildrydes/wildrydes-site ./ --recursive

This's exactly the solution for me. Thanks you!

Bigguy98 avatar Mar 04 '24 08:03 Bigguy98

the problem is that the s3 bucketv isn't publicly accessible anymore. in order to find it check it here aws s3 cp s3://ttt-wildrydes/wildrydes-site ./ --recursive

AccessDenied error is gone but now when I git push, here's the new error:

fatal: repository 'https://git-codecommit.us-west-2.amazonaws.com/v1/repos/wildrydes-site/' not found

Change the remote URL by running: git remote set-url origin https://git-codecommit.us-east-1.amazonaws.com/v1/repos/wildrydes-site

then run

git push

A-ravi avatar Mar 15 '24 07:03 A-ravi

aws s3 cp s3://ttt-wildrydes/wildrydes-site ./ --recursive

mhnrj1993 avatar Mar 16 '24 10:03 mhnrj1993

it works

mhnrj1993 avatar Mar 16 '24 10:03 mhnrj1993

the problem is that the s3 bucketv isn't publicly accessible anymore. in order to find it check it here aws s3 cp s3://ttt-wildrydes/wildrydes-site ./ --recursive

That solved my issue, thanks man!

i-moreno avatar Mar 28 '24 19:03 i-moreno

the problem is that the s3 bucketv isn't publicly accessible anymore. in order to find it check it here aws s3 cp s3://ttt-wildrydes/wildrydes-site ./ --recursive

You are a savior 🙏

meghnadutta02 avatar Apr 06 '24 06:04 meghnadutta02