redpanda icon indicating copy to clipboard operation
redpanda copied to clipboard

Published 20 hours ago • verified publisher icon redpanda-data

CI Failure (Data never drops below 1MB) in `FullDiskReclaimTest.test_full_disk_triggers_gc`

Open vbotbuildovich opened this issue 10 months ago • 13 comments

https://buildkite.com/redpanda/redpanda/builds/47684 https://buildkite.com/redpanda/redpanda/builds/47778

Module: rptest.tests.full_disk_test
Class: FullDiskReclaimTest
Method: test_full_disk_triggers_gc

test_id:    FullDiskReclaimTest.test_full_disk_triggers_gc
status:     FAIL
run time:   64.615 seconds

TimeoutError('')
Traceback (most recent call last):
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/tests/runner_client.py", line 276, in run_test
    return self.test_context.function(self.test)
  File "/root/tests/rptest/services/cluster.py", line 104, in wrapped
    r = f(self, *args, **kwargs)
  File "/root/tests/rptest/tests/full_disk_test.py", line 315, in test_full_disk_triggers_gc
    wait_until(lambda: observed_data_size(lambda s: s < nbytes(1)),
  File "/opt/.ducktape-venv/lib/python3.10/site-packages/ducktape/utils/util.py", line 57, in wait_until
    raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from last_exception
ducktape.errors.TimeoutError

JIRA Link: CORE-2506

vbotbuildovich avatar Apr 22 '24 22:04 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/48390

vbotbuildovich avatar Apr 28 '24 21:04 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/48981

vbotbuildovich avatar May 12 '24 21:05 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/49200 *https://buildkite.com/redpanda/redpanda/builds/49306 *https://buildkite.com/redpanda/redpanda/builds/49358

vbotbuildovich avatar May 21 '24 21:05 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/49575

vbotbuildovich avatar May 27 '24 21:05 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/49701

vbotbuildovich avatar May 31 '24 21:05 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50041 *https://buildkite.com/redpanda/redpanda/builds/50063 *https://buildkite.com/redpanda/redpanda/builds/50079

vbotbuildovich avatar Jun 10 '24 23:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50079 *https://buildkite.com/redpanda/redpanda/builds/50095 *https://buildkite.com/redpanda/redpanda/builds/50116

vbotbuildovich avatar Jun 11 '24 20:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50079 *https://buildkite.com/redpanda/redpanda/builds/50095 *https://buildkite.com/redpanda/redpanda/builds/50116

vbotbuildovich avatar Jun 11 '24 21:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50079 *https://buildkite.com/redpanda/redpanda/builds/50095 *https://buildkite.com/redpanda/redpanda/builds/50116

vbotbuildovich avatar Jun 11 '24 21:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50079 *https://buildkite.com/redpanda/redpanda/builds/50095 *https://buildkite.com/redpanda/redpanda/builds/50116 *https://buildkite.com/redpanda/redpanda/builds/50145

vbotbuildovich avatar Jun 12 '24 21:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50234 *https://buildkite.com/redpanda/redpanda/builds/50330 *https://buildkite.com/redpanda/redpanda/builds/50338 *https://buildkite.com/redpanda/redpanda/builds/50356 *https://buildkite.com/redpanda/redpanda/builds/50421

vbotbuildovich avatar Jun 20 '24 03:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50507

vbotbuildovich avatar Jun 27 '24 13:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50807

vbotbuildovich avatar Jun 28 '24 00:06 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50920 *https://buildkite.com/redpanda/redpanda/builds/50932 *https://buildkite.com/redpanda/redpanda/builds/50937 *https://buildkite.com/redpanda/redpanda/builds/51038

vbotbuildovich avatar Jul 04 '24 23:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/50920 *https://buildkite.com/redpanda/redpanda/builds/50932 *https://buildkite.com/redpanda/redpanda/builds/50937 *https://buildkite.com/redpanda/redpanda/builds/51038

vbotbuildovich avatar Jul 05 '24 00:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/51131 *https://buildkite.com/redpanda/redpanda/builds/51133

vbotbuildovich avatar Jul 05 '24 19:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/51203 *https://buildkite.com/redpanda/redpanda/builds/51209

vbotbuildovich avatar Jul 08 '24 21:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/51352 *https://buildkite.com/redpanda/redpanda/builds/51358 *https://buildkite.com/redpanda/redpanda/builds/51421 *https://buildkite.com/redpanda/redpanda/builds/51429 *https://buildkite.com/redpanda/redpanda/builds/51415 *https://buildkite.com/redpanda/redpanda/builds/51461

vbotbuildovich avatar Jul 15 '24 09:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/51601 *https://buildkite.com/redpanda/redpanda/builds/51681

vbotbuildovich avatar Jul 17 '24 21:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/51720

vbotbuildovich avatar Jul 18 '24 21:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/51771

vbotbuildovich avatar Jul 19 '24 21:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/51850 *https://buildkite.com/redpanda/redpanda/builds/51865

vbotbuildovich avatar Jul 22 '24 21:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/51905

vbotbuildovich avatar Jul 23 '24 21:07 vbotbuildovich

*https://buildkite.com/redpanda/redpanda/builds/52007

vbotbuildovich avatar Jul 26 '24 04:07 vbotbuildovich

#22686 has been reverted, so this one reproduces again: https://ci-artifacts.dev.vectorized.cloud/redpanda/53898/0191b3db-cc35-4ea3-a215-24666ed8e21a/vbuild/ducktape/results/final/report.html

bashtanov avatar Sep 02 '24 20:09 bashtanov

cc: @lf-rep

piyushredpanda avatar Sep 03 '24 08:09 piyushredpanda