redpanda icon indicating copy to clipboard operation
redpanda copied to clipboard

Published 20 hours ago • verified publisher icon redpanda-data

CI Failure (key symptom) in `CloudStorageTimingStressTest.test_cloud_storage`

Open vbotbuildovich opened this issue 1 year ago • 7 comments

https://buildkite.com/redpanda/redpanda/builds/43705

Module: rptest.tests.cloud_storage_timing_stress_test
Class: CloudStorageTimingStressTest
Method: test_cloud_storage
Arguments: {
    "cleanup_policy": "delete"
}

test_id:    CloudStorageTimingStressTest.test_cloud_storage
status:     FAIL
run time:   693.441 seconds

TimeoutError("Consumer hasn't read all produced data: consumed={'0': 7472} produced={'0': 15359}")
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 269, in run_test
    return self.test_context.function(self.test)
  File "/usr/local/lib/python3.10/dist-packages/ducktape/mark/_mark.py", line 481, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/root/tests/rptest/services/cluster.py", line 82, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/cloud_storage_timing_stress_test.py", line 509, in test_cloud_storage
    self.epilogue(cleanup_policy)
  File "/root/tests/rptest/tests/cloud_storage_timing_stress_test.py", line 424, in epilogue
    self.consumer.wait()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/services/service.py", line 287, in wait
    if not self.wait_node(node, end - now):
  File "/root/tests/rptest/services/kgo_verifier_services.py", line 713, in wait_node
    wait_until(
  File "/usr/local/lib/python3.10/dist-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError: Consumer hasn't read all produced data: consumed={'0': 7472} produced={'0': 15359}

JIRA Link: CORE-1717

vbotbuildovich avatar Jan 16 '24 23:01 vbotbuildovich

*https://buildkite.com/redpanda/vtools/builds/11992

vbotbuildovich avatar Feb 27 '24 06:02 vbotbuildovich

*https://buildkite.com/redpanda/vtools/builds/12024

vbotbuildovich avatar Feb 29 '24 00:02 vbotbuildovich

*https://buildkite.com/redpanda/vtools/builds/12046

vbotbuildovich avatar Mar 04 '24 18:03 vbotbuildovich

*https://buildkite.com/redpanda/vtools/builds/12490

vbotbuildovich avatar Mar 25 '24 13:03 vbotbuildovich

*https://buildkite.com/redpanda/vtools/builds/12890

vbotbuildovich avatar Apr 16 '24 21:04 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/48235

vbotbuildovich avatar Apr 25 '24 21:04 vbotbuildovich

*https://buildkite.com/redpanda/vtools/builds/13384

vbotbuildovich avatar May 01 '24 21:05 vbotbuildovich

*https://buildkite.com/redpanda/vtools/builds/13566

vbotbuildovich avatar May 08 '24 21:05 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/48235 *https://buildkite.com/redpanda/vtools/builds/13384 *https://buildkite.com/redpanda/vtools/builds/13566

vbotbuildovich avatar Jun 11 '24 20:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/48235 *https://buildkite.com/redpanda/vtools/builds/13384 *https://buildkite.com/redpanda/vtools/builds/13566

vbotbuildovich avatar Jun 11 '24 21:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/48235 *https://buildkite.com/redpanda/vtools/builds/13384 *https://buildkite.com/redpanda/vtools/builds/13566

vbotbuildovich avatar Jun 11 '24 21:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/48235 *https://buildkite.com/redpanda/vtools/builds/13384 *https://buildkite.com/redpanda/vtools/builds/13566

vbotbuildovich avatar Jun 12 '24 21:06 vbotbuildovich