mimir icon indicating copy to clipboard operation
mimir copied to clipboard

Flaky TestIngester_Push_CircuitBreaker_DeadlineExceeded

Open dimitarvdimitrov opened this issue 1 year ago • 2 comments

--- FAIL: TestIngester_Push_CircuitBreaker_DeadlineExceeded (4.01s)
    --- FAIL: TestIngester_Push_CircuitBreaker_DeadlineExceeded/test_slow_push_with_initial_delay_disabled (2.00s)
        circuitbreaker_test.go:868: 
            	Error Trace:	/__w/mimir/mimir/pkg/ingester/circuitbreaker_test.go:868
            	Error:      	Received unexpected error:
            	            	circuit breaker open on push request type with remaining delay 9.999971526s
            	Test:       	TestIngester_Push_CircuitBreaker_DeadlineExceeded/test_slow_push_with_initial_delay_disabled
method=Ingester.Shipper.Sync level=info msg="uploading new block to long-term storage" block=00000000010000000000000000
method=Ingester.Shipper.Sync level=debug msg="uploaded file" from=/tmp/TestShipper_DeceivingUploadErrors3414665781/001/00000000010000000000000000/index dst=00000000010000000000000000/index bucket="fs: /tmp/TestShipper_DeceivingUploadErrors3414665781/002"
method=Ingester.Shipper.Sync level=error msg="uploading new block to long-term storage failed" block=00000000010000000000000000 err="upload meta file: base name matches, will fail upload"
FAIL

dimitarvdimitrov avatar Oct 25 '24 17:10 dimitarvdimitrov

@duricanikolic does this ring any bells? I see mostly your name around this test

dimitarvdimitrov avatar Oct 25 '24 17:10 dimitarvdimitrov

Failed again: https://github.com/grafana/mimir/actions/runs/11775473304/job/32796019220

gotjosh avatar Nov 11 '24 09:11 gotjosh