aws
aws s3 cp not working
Describe the bug
Summary
After running pip install awscli which automatically installed version 1.40.21, the copy command is not working in my CI/CD pipeline running on CircleCI:
aws s3 cp s3://my-bucket/path/ ./ --recursive
Regression Issue
- [ ] Select this option if this issue appears to be a regression.
Expected Behavior
Files should be copied to a specified directory given an S3 URI
Current Behavior
Files are NOT being copied to the directory I specified.
Reproduction Steps
aws s3 cp s3://my-bucket/path/ ./ --recursive
Possible Solution
No response
Additional Information/Context
No response
CLI version used
1.40.21
Environment details (OS name and version, etc.)
Circle CI
Hey @tristanoprofetto, thanks for reaching out. Could you elaborate a bit on what type of issue you're seeing? Is the operation succeeding without making any copies, or are you getting an error? Debug logs would be really helpful here; you can get debug logs by adding --debug to your command, and redacting any sensitive information. Thanks!
Could you verify that you're using s3transfer = 0.13.0? We received a similar issue that was caused by using incompatible versions of awscli and s3transfer.
Greetings! It looks like this issue hasn’t been active in longer than five days. We encourage you to check if this is still an issue in the latest release. In the absence of more information, we will be closing this issue soon. If you find that this is still a problem, please feel free to provide a comment or upvote with a reaction on the initial post to prevent automatic closure. If the issue is already closed, please feel free to open a new one.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
I ran into same issue few days back. we downgraded the CLI version to what was working before.
working: awscli-1.40.20 botocore-1.38.21 s3transfer-0.12.0 Not working: awscli-1.40.21 botocore-1.38.22 s3transfer-0.13.0
I ran into same issue few days back. we downgraded the CLI version to what was working before.
working: awscli-1.40.20 botocore-1.38.21 s3transfer-0.12.0 Not working: awscli-1.40.21 botocore-1.38.22 s3transfer-0.13.0
What error are you getting?
unfortunately, there's no error in the logs. The copy just does not happen !! The build eventually fails though but only because the files that were supposed to be in the S3 bucket are not present.
unfortunately, there's no error in the logs. The copy just does not happen !! The build eventually fails though but only because the files that were supposed to be in the S3 bucket are not present.
Could you share debug logs of that behavior? You can get debug logs by adding --debug to your command, and redacting any sensitive information. Thanks!
Greetings! It looks like this issue hasn’t been active in longer than five days. We encourage you to check if this is still an issue in the latest release. In the absence of more information, we will be closing this issue soon. If you find that this is still a problem, please feel free to provide a comment or upvote with a reaction on the initial post to prevent automatic closure. If the issue is already closed, please feel free to open a new one.