google-cloud-go icon indicating copy to clipboard operation
google-cloud-go copied to clipboard

storage: TestRetryConformance failed

Open flaky-bot[bot] opened this issue 2 years ago • 6 comments

Note: #8185 was also for this test, but it was closed more than 10 days ago. So, I didn't mark it flaky.


commit: cae54ed31548e6f17f3b6bc217bb117723f04e15 buildURL: Build Status, Sponge status: failed

flaky-bot[bot] avatar Dec 15 '23 11:12 flaky-bot[bot]

Test passed for commit 69c49f2537af8064e7b18e4845c3b2fbd502f141 (Build Status, Sponge)! Closing this issue.

flaky-bot[bot] avatar Dec 15 '23 22:12 flaky-bot[bot]

Looks like this issue is flaky. :worried:

I'm going to leave this open and stop commenting.

A human should fix and close this.


commit: ec9b5268627734c40efd15353cf4bc83a837ff3a buildURL: Build Status, Sponge status: failed

flaky-bot[bot] avatar Dec 22 '23 10:12 flaky-bot[bot]

=== RUN   TestRetryConformance/2-[return-reset-connection_return-reset-connection]-storage.objects.insert-0
    retry_conformance_test.go:753: roundtrip error (may be expected): write tcp 127.0.0.1:60652->127.0.0.1:9000: write: broken pipe
        request: POST /upload/storage/v1/b/bucket-20231222-35551646713864-0060/o?alt=json&ifGenerationMatch=0&name=new-object.txt&prettyPrint=false&projection=full&uploadType=multipart HTTP/1.1
        Host: localhost:9000
        Content-Type: ...
        
    retry_conformance_test.go:539: want success, got Writer.Close: Post "[http://localhost:9000/upload/storage/v1/b/bucket-20231222-35551646713864-0060/o?alt=json&ifGenerationMatch=0&name=new-object.txt&prettyPrint=false&projection=full&uploadType=multipart](https://www.google.com/url?q=http://localhost:9000/upload/storage/v1/b/bucket-20231222-35551646713864-0060/o?alt%3Djson%26ifGenerationMatch%3D0%26name%3Dnew-object.txt%26prettyPrint%3Dfalse%26projection%3Dfull%26uploadType%3Dmultipart&sa=D)": write tcp 127.0.0.1:60652->127.0.0.1:9000: write: broken pipe
    retry_conformance_test.go:718: test not completed; unused instructions: map[storage.objects.insert:[return-reset-connection]]

BrennaEpp avatar Dec 27 '23 20:12 BrennaEpp

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 82054d0e6905358e48517cbc8ea844dfb624082c buildURL: Build Status, Sponge status: failed

flaky-bot[bot] avatar Jan 05 '24 20:01 flaky-bot[bot]

Not sure why I originally closed this issue. Error from the latest comment is the same as above.

BrennaEpp avatar Jan 24 '24 06:01 BrennaEpp

=== RUN   TestRetryConformance/http-6-[return-reset-connection_return-401]-storage.objects.insert-1
    retry_conformance_test.go:821: test not completed; unused instructions: map[storage.objects.insert:[return-401]]

^ Recently got this error as well.

BrennaEpp avatar Apr 03 '24 04:04 BrennaEpp

Beefed up retry logic for broken pipe errors in this repo and in apiary. We should see fewer flakes on this test especially once we pick up the new release of the apiary client.

tritone avatar Jun 12 '24 22:06 tritone

Oops! Looks like this issue is still flaky. It failed again. :grimacing:

I reopened the issue, but a human will need to close it again.


commit: 1e2af816f44f23ed42cab98b0ef5b992ebcb92f9 buildURL: Build Status, Sponge status: failed

flaky-bot[bot] avatar Jun 17 '24 22:06 flaky-bot[bot]

Latest failure should be fixed by the Apiary library patch as soon as we pick up the new release.

tritone avatar Jun 17 '24 22:06 tritone