CI Failure (key symptom) in `CompactionE2EIdempotencyTest.test_basic_compaction`

[vbotbuildovich]

https://buildkite.com/redpanda/redpanda/builds/44723

Module: rptest.tests.compaction_e2e_test
Class: CompactionE2EIdempotencyTest
Method: test_basic_compaction
Arguments: {
    "workload": "TX_UNIQUE_KEYS",
    "initial_cleanup_policy": "delete"
}

test_id:    CompactionE2EIdempotencyTest.test_basic_compaction
status:     FAIL
run time:   65.261 seconds

<BadLogLines nodes=docker-rp-23(1) example="ERROR 2024-02-06 02:30:27,143 [shard 1:fetc] kafka - fetch.cc:1171 - unknown exception thrown: std::runtime_error (Attempted to perform operation: 'offset_data_stream()' on a closed segment: {offset_tracker:{term:1, base_offset:25251, committed_offset:31562, dirty_offset:31562}, compacted_segment=1, finished_self_compaction=1, finished_windowed_compaction=1, generation={3898}, reader={/var/lib/redpanda/data/kafka/topic-umnudcktjc/1_24/25251-1-v1.log, (5117235 bytes)}, writer=nullptr, cache=nullptr, compaction_index:nullopt, closed=1, tombstone=1, index={file:/var/lib/redpanda/data/kafka/topic-umnudcktjc/1_24/25251-1-v1.base_index, offsets:{0}, index:{header_bitflags:0, base_offset:{0}, max_offset:{31562}, base_timestamp:{timestamp: 1707186596955}, max_timestamp:{timestamp: 1707186599678}, batch_timestamps_are_monotonic:1, with_offset:true, non_data_timestamps:0, broker_timestamp:{{timestamp: 1707186599681}}, num_compactible_records_appended:{4850}, index(122,122,122)}, step:32768, needs_persistence:0}})">
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 184, in _do_run
    data = self.run_test()
  File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 269, in run_test
    return self.test_context.function(self.test)
  File "/usr/local/lib/python3.10/dist-packages/ducktape/mark/_mark.py", line 481, in wrapper
    return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
  File "/root/tests/rptest/services/cluster.py", line 168, in wrapped
    redpanda.raise_on_bad_logs(
  File "/root/tests/rptest/services/redpanda.py", line 1413, in raise_on_bad_logs
    raise BadLogLines(bad_lines)
rptest.services.utils.BadLogLines: <BadLogLines nodes=docker-rp-23(1) example="ERROR 2024-02-06 02:30:27,143 [shard 1:fetc] kafka - fetch.cc:1171 - unknown exception thrown: std::runtime_error (Attempted to perform operation: 'offset_data_stream()' on a closed segment: {offset_tracker:{term:1, base_offset:25251, committed_offset:31562, dirty_offset:31562}, compacted_segment=1, finished_self_compaction=1, finished_windowed_compaction=1, generation={3898}, reader={/var/lib/redpanda/data/kafka/topic-umnudcktjc/1_24/25251-1-v1.log, (5117235 bytes)}, writer=nullptr, cache=nullptr, compaction_index:nullopt, closed=1, tombstone=1, index={file:/var/lib/redpanda/data/kafka/topic-umnudcktjc/1_24/25251-1-v1.base_index, offsets:{0}, index:{header_bitflags:0, base_offset:{0}, max_offset:{31562}, base_timestamp:{timestamp: 1707186596955}, max_timestamp:{timestamp: 1707186599678}, batch_timestamps_are_monotonic:1, with_offset:true, non_data_timestamps:0, broker_timestamp:{{timestamp: 1707186599681}}, num_compactible_records_appended:{4850}, index(122,122,122)}, step:32768, needs_persistence:0}})">

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/45067

[vbotbuildovich]

*https://buildkite.com/redpanda/redpanda/builds/45179

[piyushredpanda]

Not seen in at 6 weeks, closing