edge icon indicating copy to clipboard operation
edge copied to clipboard

Published 20 hours ago • verified publisher icon storj

AWS CLI test is flaky

Open amwolff opened this issue 2 years ago • 6 comments

From https://build.dev.storj.io/blue/organizations/jenkins/gateway-mt-gerrit/detail/gateway-mt-gerrit/3901/pipeline:

[...]
delete: s3://bucket/big-testfile
delete: s3://bucket/small-testfile
delete: s3://bucket/big-testfile-moved
delete: s3://bucket/big-testfile-copy
delete: s3://bucket/multipart-testfile
remove_bucket failed: s3://bucket An error occurred (BucketNotEmpty) when calling the DeleteBucket operation: The bucket you tried to delete is not empty
error code 1 in 119 /var/lib/jenkins/workspace/gateway-mt-gerrit/gateway-st/testsuite/integration/awscli.sh line 6 :: aws s3 --endpoint "$AWS_ENDPOINT" rb "s3://$BUCKET" --force
script returned exit code 1

It seems like one pending multipart upload, or two, isn't getting completed or aborted.

amwolff avatar Apr 20 '22 13:04 amwolff

Change https://review.dev.storj.io/c/storj/gateway/+/7340 mentions this issue.

storjBuildBot avatar Apr 21 '22 01:04 storjBuildBot

Still flaky, unfortunately: https://build.dev.storj.io/blue/organizations/jenkins/gateway-mt-gerrit/detail/gateway-mt-gerrit/3922/pipeline/.

amwolff avatar Apr 25 '22 11:04 amwolff

It looks like a problem with Server-Side Copy/Move: https://build.dev.storj.io/blue/organizations/jenkins/gateway-st-gerrit/detail/gateway-st-gerrit/1703/pipeline.

amwolff avatar Apr 25 '22 12:04 amwolff

Yes, it looks there is something funky when doing parallel deletes of copies. I'm investigating that.

mniewrzal avatar Apr 25 '22 14:04 mniewrzal

Change https://review.dev.storj.io/c/storj/gateway/+/7360 mentions this issue.

storjBuildBot avatar Apr 26 '22 16:04 storjBuildBot

Still flaky, unfortunately: https://build.dev.storj.io/blue/organizations/jenkins/gateway-mt-gerrit/detail/gateway-mt-gerrit/4892/pipeline/

amwolff avatar Sep 01 '22 15:09 amwolff