redpanda icon indicating copy to clipboard operation
redpanda copied to clipboard

Fix spillover inconsistency

Open Lazin opened this issue 8 months ago • 19 comments

In case if the first spillover manifest can't be added the following chain of events occurs:

  • The ntp_archiver uploads a spillover manifest and replicates three commands. The first command adds a spillover manifest to the list and two remaining commands are setting values for archive start/clean offsets.
  • If the spillover_cmd command can't be applied the two other commands are applied anyway.
  • The result is that the start archive offset overshoots the start offset.

When the partition is in this state the assertion could be triggered.

The PR fixes this by allowing the second command to fail if the first one failed.

Fixes https://redpandadata.atlassian.net/browse/CORE-9914

Backports Required

  • [ ] none - not a bug fix
  • [ ] none - this is a backport
  • [ ] none - issue does not exist in previous branches
  • [ ] none - papercut/not impactful enough to backport
  • [x] v25.1.x
  • [x] v24.3.x
  • [x] v24.2.x
  • [ ] v24.1.x

Release Notes

  • none

Lazin avatar Apr 27 '25 09:04 Lazin

:tada: Snyk checks have passed. No issues have been found so far.

:white_check_mark: security/snyk check is complete. No issues have been found. (View Details)

:white_check_mark: license/snyk check is complete. No issues have been found. (View Details)

secpanda avatar Apr 27 '25 09:04 secpanda

:tada: Snyk checks have passed. No issues have been found so far.

:white_check_mark: security/snyk check is complete. No issues have been found. (View Details)

:white_check_mark: license/snyk check is complete. No issues have been found. (View Details)

secpanda avatar Apr 27 '25 09:04 secpanda

Retry command for Build#65150

please wait until all jobs are finished before running the slash command



/ci-repeat 1
tests/rptest/transactions/consumer_offsets_test.py::VerifyConsumerOffsets.test_consumer_group_offsets
tests/rptest/tests/data_migrations_api_test.py::DataMigrationsApiTest.test_conflicting_names
tests/rptest/tests/random_node_operations_test.py::RandomNodeOperationsTest.test_node_operations@{"cloud_storage_type":1,"enable_failures":true,"mixed_versions":false,"with_chunked_compaction":true,"with_iceberg":true,"with_tiered_storage":false}
tests/rptest/tests/simple_e2e_test.py::SimpleEndToEndTest.test_consumer_interruption

vbotbuildovich avatar Apr 27 '25 12:04 vbotbuildovich

CI test results

test results on build#65150
test_id test_kind job_url test_status passed
cloud_storage_rpfixture.cloud_storage_rpfixture unit https://buildkite.com/redpanda/redpanda/builds/65150#01967685-33a2-4422-9ac2-2fdcbd5d8955 FAIL 0/2
cloud_storage_rpfixture.cloud_storage_rpfixture unit https://buildkite.com/redpanda/redpanda/builds/65150#01967685-33a3-42e9-b5d8-8cfe6461a01f FAIL 0/2
rptest.tests.data_migrations_api_test.DataMigrationsApiTest.test_conflicting_names ducktape https://buildkite.com/redpanda/redpanda/builds/65150#019676c5-37fe-49d3-975a-91302056e747 FLAKY 8/21
rptest.tests.data_migrations_api_test.DataMigrationsApiTest.test_conflicting_names ducktape https://buildkite.com/redpanda/redpanda/builds/65150#019676e0-cbfe-43cd-b5db-fc57a9373c34 FLAKY 6/21
rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=True.mixed_versions=False.with_tiered_storage=False.with_iceberg=True.with_chunked_compaction=True.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65150#019676e0-cbfd-4e7c-a7b6-0c3130d26ec4 FLAKY 19/21
rptest.tests.simple_e2e_test.SimpleEndToEndTest.test_consumer_interruption ducktape https://buildkite.com/redpanda/redpanda/builds/65150#019676e0-cbfd-4e7c-a7b6-0c3130d26ec4 FLAKY 7/21
rptest.transactions.consumer_offsets_test.VerifyConsumerOffsets.test_consumer_group_offsets ducktape https://buildkite.com/redpanda/redpanda/builds/65150#019676c5-37fd-4ca8-9120-be68633d0297 FLAKY 18/21
test results on build#65152
test_id test_kind job_url test_status passed
gtest_raft_rpunit.gtest_raft_rpunit unit https://buildkite.com/redpanda/redpanda/builds/65152#01967952-ce9a-455f-8205-91256dfab2f8 FLAKY 1/2
kafka_server_rpfixture.kafka_server_rpfixture unit https://buildkite.com/redpanda/redpanda/builds/65152#01967952-ce9a-455f-8205-91256dfab2f8 FLAKY 1/2
rptest.tests.data_migrations_api_test.DataMigrationsApiTest.test_conflicting_names ducktape https://buildkite.com/redpanda/redpanda/builds/65152#019679ab-13a8-4591-9602-3da901a52042 FLAKY 8/21
rptest.tests.scaling_up_test.ScalingUpTest.test_scaling_up_with_recovered_topic ducktape https://buildkite.com/redpanda/redpanda/builds/65152#019679ac-dac8-4c73-a33b-bda3f9f9621a FLAKY 16/21
test results on build#65166
test_id test_kind job_url test_status passed
rptest.tests.data_migrations_api_test.DataMigrationsApiTest.test_conflicting_names ducktape https://buildkite.com/redpanda/redpanda/builds/65166#01967b65-e8ee-4f57-aaaf-950b656aa60f FLAKY 6/21
test results on build#65225
test_id test_kind job_url test_status passed
cloud_storage_rpunit.cloud_storage_rpunit unit https://buildkite.com/redpanda/redpanda/builds/65225#019680cf-e24e-42a6-b62f-6b8af14d5860 FAIL 0/2
cloud_storage_rpunit.cloud_storage_rpunit unit https://buildkite.com/redpanda/redpanda/builds/65225#019680cf-e24f-42a3-8a70-346c82e5f11f FAIL 0/2
rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.ABS.retention_type=retention.bytes ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/21
rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.ABS.retention_type=retention.bytes ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.ABS.retention_type=retention.ms ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/21
rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.ABS.retention_type=retention.ms ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/21
rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.S3.retention_type=retention.bytes ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/21
rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.S3.retention_type=retention.bytes ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/21
rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.S3.retention_type=retention.ms ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/21
rptest.tests.archive_retention_test.CloudArchiveRetentionTest.test_delete.cloud_storage_type=CloudStorageType.S3.retention_type=retention.ms ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.cloud_storage_scrubber_test.CloudStorageScrubberTest.test_scrubber.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/21
rptest.tests.cloud_storage_scrubber_test.CloudStorageScrubberTest.test_scrubber.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.cloud_storage_scrubber_test.CloudStorageScrubberTest.test_scrubber.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/21
rptest.tests.cloud_storage_scrubber_test.CloudStorageScrubberTest.test_scrubber.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
rptest.tests.cloud_storage_timing_stress_test.CloudStorageTimingStressTest.test_cloud_storage.cleanup_policy=compact.delete ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/21
rptest.tests.cloud_storage_timing_stress_test.CloudStorageTimingStressTest.test_cloud_storage.cleanup_policy=delete ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/21
rptest.tests.cloud_storage_timing_stress_test.CloudStorageTimingStressTest.test_cloud_storage_with_partition_moves.cleanup_policy=compact.delete ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.cloud_storage_timing_stress_test.CloudStorageTimingStressTest.test_cloud_storage_with_partition_moves.cleanup_policy=delete ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
rptest.tests.data_migrations_api_test.DataMigrationsApiTest.test_conflicting_names ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FLAKY 12/21
rptest.tests.data_migrations_api_test.DataMigrationsApiTest.test_conflicting_names ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FLAKY 8/21
rptest.tests.datalake.blocked_catalog_test.DatalakeBlockedCatalogTest.test_block_cloud_retention_before_translation.cloud_storage_type=CloudStorageType.S3.with_spillover=True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/21
rptest.tests.datalake.blocked_catalog_test.DatalakeBlockedCatalogTest.test_block_cloud_retention_before_translation.cloud_storage_type=CloudStorageType.S3.with_spillover=True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndShadowIndexingTest.test_reset_from_cloud.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndShadowIndexingTest.test_reset_from_cloud.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.e2e_shadow_indexing_test.EndToEndShadowIndexingTest.test_reset_from_cloud.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndShadowIndexingTest.test_reset_from_cloud.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndShadowIndexingTest.test_reset_spillover.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndShadowIndexingTest.test_reset_spillover.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndShadowIndexingTest.test_reset_spillover.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndShadowIndexingTest.test_reset_spillover.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndSpilloverTest.test_spillover.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndSpilloverTest.test_spillover.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.e2e_shadow_indexing_test.EndToEndSpilloverTest.test_spillover.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/21
rptest.tests.e2e_shadow_indexing_test.EndToEndSpilloverTest.test_spillover.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
rptest.tests.offset_for_leader_epoch_archival_test.OffsetForLeaderEpochArchivalTest.test_querying_archive ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/21
rptest.tests.offset_for_leader_epoch_archival_test.OffsetForLeaderEpochArchivalTest.test_querying_archive ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/21
rptest.tests.random_node_operations_test.RandomNodeOperationsTest.test_node_operations.enable_failures=True.mixed_versions=False.with_tiered_storage=True.with_iceberg=False.with_chunked_compaction=True.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.read_replica_e2e_test.TestReadReplicaService.test_partition_movement.partition_count=10 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/21
rptest.tests.read_replica_e2e_test.TestReadReplicaService.test_partition_movement.partition_count=10 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.read_replica_e2e_test.TestReadReplicaService.test_simple_end_to_end.partition_count=10.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/1
rptest.tests.read_replica_e2e_test.TestReadReplicaService.test_simple_end_to_end.partition_count=10.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/1
rptest.tests.read_replica_e2e_test.TestReadReplicaService.test_simple_end_to_end.partition_count=10.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/1
rptest.tests.read_replica_e2e_test.TestReadReplicaService.test_simple_end_to_end.partition_count=10.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/1
rptest.tests.read_replica_e2e_test.TestReadReplicaService.test_simple_end_to_end.partition_count=10.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/1
rptest.tests.read_replica_e2e_test.TestReadReplicaService.test_simple_end_to_end.partition_count=10.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/1
rptest.tests.simple_e2e_test.SimpleEndToEndTest.test_consumer_interruption ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Delete==True.SpilloverManifestUploaded==True.TS_Spillover_ManifestDeleted==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Delete==True.SpilloverManifestUploaded==True.TS_Spillover_ManifestDeleted==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Read==True.AdjacentSegmentMergerReupload==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Read==True.AdjacentSegmentMergerReupload==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Read==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Read==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Read==True.TS_Timequery==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Read==True.TS_Timequery==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Read==True.TS_TxRangeMaterialized==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.ABS.2.virtual_host.test_case=.TS_Read==True.TS_TxRangeMaterialized==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Delete==True.SpilloverManifestUploaded==True.TS_Spillover_ManifestDeleted==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Delete==True.SpilloverManifestUploaded==True.TS_Spillover_ManifestDeleted==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Read==True.AdjacentSegmentMergerReupload==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Read==True.AdjacentSegmentMergerReupload==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Read==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Read==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Read==True.TS_Timequery==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Read==True.TS_Timequery==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Read==True.TS_TxRangeMaterialized==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.path.test_case=.TS_Read==True.TS_TxRangeMaterialized==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Delete==True.SpilloverManifestUploaded==True.TS_Spillover_ManifestDeleted==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Delete==True.SpilloverManifestUploaded==True.TS_Spillover_ManifestDeleted==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Read==True.AdjacentSegmentMergerReupload==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Read==True.AdjacentSegmentMergerReupload==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Read==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Read==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Read==True.TS_Timequery==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Read==True.TS_Timequery==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Read==True.TS_TxRangeMaterialized==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/1
rptest.tests.tiered_storage_model_test.TieredStorageTest.test_tiered_storage.cloud_storage_type_and_url_style=.CloudStorageType.S3.1.virtual_host.test_case=.TS_Read==True.TS_TxRangeMaterialized==True.SpilloverManifestUploaded==True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/1
rptest.tests.timequery_test.TimeQueryTest.test_timequery.cloud_storage=True.batch_cache=False.spillover=True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/21
rptest.tests.timequery_test.TimeQueryTest.test_timequery.cloud_storage=True.batch_cache=False.spillover=True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
rptest.tests.timequery_test.TimeQueryTest.test_timequery_with_spillover_gc_delayed ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4843-4484-8cc6-72db00392b92 FAIL 0/21
rptest.tests.timequery_test.TimeQueryTest.test_timequery_with_spillover_gc_delayed ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/21
rptest.tests.timequery_test.TimeQueryTest.test_timequery_with_trim_prefix.cloud_storage=True.spillover=True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-4f30-8484-0c3976fe9c4f FAIL 0/21
rptest.tests.timequery_test.TimeQueryTest.test_timequery_with_trim_prefix.cloud_storage=True.spillover=True ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.drop_lifecycle_marker_test.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4841-4599-afb0-f38c471005b5 FAIL 0/21
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.drop_lifecycle_marker_test.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/21
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.drop_lifecycle_marker_test.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#0196810f-4842-490c-be90-d381d988becc FAIL 0/21
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.drop_lifecycle_marker_test.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.topic_delete_cloud_storage_test.disable_delete=False.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4a55-97f4-c3611de56cec FAIL 0/21
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.topic_delete_cloud_storage_test.disable_delete=False.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.topic_delete_cloud_storage_test.disable_delete=True.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.topic_delete_cloud_storage_test.disable_delete=True.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c69-4955-aef3-3dc837f3aee1 FAIL 0/21
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.topic_delete_unavailable_test.cloud_storage_type=CloudStorageType.ABS ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c67-4a5b-ae20-3a53aed158d0 FAIL 0/1
rptest.tests.topic_delete_test.TopicDeleteCloudStorageTest.topic_delete_unavailable_test.cloud_storage_type=CloudStorageType.S3 ducktape https://buildkite.com/redpanda/redpanda/builds/65225#01968114-1c68-4388-b462-57573e7d9c35 FAIL 0/21
test results on build#65262
test_id test_kind job_url test_status passed
gtest_storage_e2e_rpfixture.gtest_storage_e2e_rpfixture unit https://buildkite.com/redpanda/redpanda/builds/65262#0196835f-f0e0-4069-ae2e-d731417bee9e FLAKY 1/2
rptest.tests.crl_test.CertificateRevocationTest.test_rpc ducktape https://buildkite.com/redpanda/redpanda/builds/65262#019683a7-6278-4d2a-9cd0-53de7c122f05 FAIL 0/21
rptest.tests.data_migrations_api_test.DataMigrationsApiTest.test_conflicting_names ducktape https://buildkite.com/redpanda/redpanda/builds/65262#019683a7-6279-4133-a9ac-a99aa9a59089 FLAKY 6/21
rptest.tests.data_migrations_api_test.DataMigrationsApiTest.test_conflicting_names ducktape https://buildkite.com/redpanda/redpanda/builds/65262#019683bb-d03d-4dc8-b837-7f7eb3e6a027 FLAKY 6/21
rptest.tests.simple_e2e_test.SimpleEndToEndTest.test_consumer_interruption ducktape https://buildkite.com/redpanda/redpanda/builds/65262#019683bb-d03d-4dc8-b837-7f7eb3e6a027 FLAKY 9/21
test results on build#66166
test_class test_method test_arguments test_kind job_url test_status passed reason
ArchivalTest test_single_partition_leadership_transfer {"cloud_storage_type": 2} ducktape https://buildkite.com/redpanda/redpanda/builds/66166#0196e858-ced7-461b-b298-ffd6e44e5882 FLAKY 20/21 upstream reliability is '99.4949494949495'. current run reliability is '95.23809523809523'. drift is 4.25685 and the allowed drift is set to 50. The test should PASS
RandomNodeOperationsTest test_node_operations {"cloud_storage_type": 2, "enable_failures": false, "mixed_versions": false, "with_chunked_compaction": false, "with_iceberg": false, "with_tiered_storage": false} ducktape https://buildkite.com/redpanda/redpanda/builds/66166#0196e858-ced7-461b-b298-ffd6e44e5882 FLAKY 20/21 upstream reliability is '97.42268041237114'. current run reliability is '95.23809523809523'. drift is 2.18459 and the allowed drift is set to 50. The test should PASS

vbotbuildovich avatar Apr 27 '25 14:04 vbotbuildovich

Retry command for Build#65152

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/data_migrations_api_test.py::DataMigrationsApiTest.test_conflicting_names

vbotbuildovich avatar Apr 28 '25 01:04 vbotbuildovich

/ci-repeat 1 tests/rptest/tests/data_migrations_api_test.py::DataMigrationsApiTest.test_conflicting_names

Lazin avatar Apr 28 '25 06:04 Lazin

Retry command for Build#65166

please wait until all jobs are finished before running the slash command

/ci-repeat 1
tests/rptest/tests/data_migrations_api_test.py::DataMigrationsApiTest.test_conflicting_names

vbotbuildovich avatar Apr 28 '25 08:04 vbotbuildovich

2 additional questions:

  • We have clusters with gaps in manifest offset space. Moreover, it is by design since "safe pause-resume". Shouldn't spillover handle them gracefully instead of failing spillover? Why we let it fail?

  • Should we transform the assert in an exception to avoid clusters crashing? We know we have that bug in existing clusters so we have to live with it somehow.

nvartolomei avatar Apr 28 '25 09:04 nvartolomei

  • We have clusters with gaps in manifest offset space. Moreover, it is by design since "safe pause-resume". Shouldn't spillover handle them gracefully instead of failing spillover? Why we let it fail?

yes, we should allow gaps to be added to spillover list (maybe this could be an alternative fix for this issue)

  • Should we transform the assert in an exception to avoid clusters crashing? We know we have that bug in existing clusters so we have to live with it somehow.

yes, maybe, I don't have strong opinion

Lazin avatar Apr 28 '25 10:04 Lazin

In the force push:

  • the assertion is downgraded to exception
  • failed spillover operation throws the exception so the commands that follow the 'spillover' command are not applied

We still need to handle situation in which the manifest contains gaps in a meaningful way. If this PR is merged the potential inconsistency will be fixed but the spillover could get stuck.

Lazin avatar Apr 29 '25 08:04 Lazin

In the force push:

  • The ntp_archiver is forced to create spillover manifests that can be added to the STM. It will try to skip the gap if it detects one. The gaps can't be added to the spillover area of the manifest because the read path is not prepared to handle them. So the solution is to avoid gaps by choosing the right point at which the spillover manifest can end. This will allow us to use spillover with partitions that have gaps.

Lazin avatar Apr 29 '25 09:04 Lazin

@nvartolomei

We have clusters with gaps in manifest offset space. Moreover, it is by design since "safe pause-resume". Shouldn't spillover handle them gracefully instead of failing spillover? Why we let it fail?

I added the last commit to fix this for clusters with gaps. Don't have time to test it at the moment.

Lazin avatar Apr 29 '25 09:04 Lazin

So the solution is to avoid gaps by choosing the right point at which the spillover manifest can end. This will allow us to use spillover with partitions that have gaps.

Does this mean that all clusters that had at any point in time uploads paused and that resulted in gaps won't be able to use spillover?

nvartolomei avatar Apr 29 '25 11:04 nvartolomei

failed spillover operation throws the exception so the commands that follow the 'spillover' command are not applied

~~won't this get the whole stm apply operations get stuck forever?~~

No. We catch exceptions and swallow it and go past the batch 🤔 https://github.com/redpanda-data/redpanda/blob/a0d13bdfc907d718015ab4d4dcc14a3d7d5f1d2a/src/v/cluster/archival/archival_metadata_stm.cc#L1126

nvartolomei avatar Apr 29 '25 11:04 nvartolomei

Does this mean that all clusters that had at any point in time uploads paused and that resulted in gaps won't be able to use spillover?

No. The end of the spillover manifest should align with the gap in order to get into this state. In order to trigger the assertion the first spillover manifest should align with the gap.

Lazin avatar Apr 29 '25 12:04 Lazin

No. We catch exceptions and swallow it and go past the batch

by this

failed spillover operation throws the exception so the commands that follow the 'spillover' command are not applied

I meant that the commands in the same record batch will not be applied. In the problematic batch there is a spillover command followed by two other commands that shouldn't be applied if spillover command fails. Previously this was the case. The spillover command was skipped and two others were applied. Now the failed spillover command will throw the exception and two remaining commands in the same record batch will not be applied because for_each_record will exit early.

Lazin avatar Apr 29 '25 12:04 Lazin

Retry command for Build#65225

please wait until all jobs are finished before running the slash command



/ci-repeat 1
tests/rptest/tests/read_replica_e2e_test.py::TestReadReplicaService.test_simple_end_to_end@{"cloud_storage_type_and_url_style":[1,"path"],"partition_count":10}
tests/rptest/tests/archive_retention_test.py::CloudArchiveRetentionTest.test_delete@{"cloud_storage_type":2,"retention_type":"retention.bytes"}
tests/rptest/tests/cloud_storage_scrubber_test.py::CloudStorageScrubberTest.test_scrubber@{"cloud_storage_type":1}
tests/rptest/tests/e2e_shadow_indexing_test.py::EndToEndShadowIndexingTest.test_reset_spillover@{"cloud_storage_type":1}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"path"],"test_case":{"name":"(TS_Read == True, AdjacentSegmentMergerReupload == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[2,"virtual_host"],"test_case":{"name":"(TS_Delete == True, SpilloverManifestUploaded == True, TS_Spillover_ManifestDeleted == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[2,"virtual_host"],"test_case":{"name":"(TS_Read == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/topic_delete_test.py::TopicDeleteCloudStorageTest.drop_lifecycle_marker_test@{"cloud_storage_type":1}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"virtual_host"],"test_case":{"name":"(TS_Delete == True, SpilloverManifestUploaded == True, TS_Spillover_ManifestDeleted == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"virtual_host"],"test_case":{"name":"(TS_Read == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/read_replica_e2e_test.py::TestReadReplicaService.test_simple_end_to_end@{"cloud_storage_type_and_url_style":[1,"virtual_host"],"partition_count":10}
tests/rptest/tests/archive_retention_test.py::CloudArchiveRetentionTest.test_delete@{"cloud_storage_type":2,"retention_type":"retention.ms"}
tests/rptest/tests/e2e_shadow_indexing_test.py::EndToEndSpilloverTest.test_spillover@{"cloud_storage_type":2}
tests/rptest/tests/e2e_shadow_indexing_test.py::EndToEndShadowIndexingTest.test_reset_from_cloud@{"cloud_storage_type":2}
tests/rptest/tests/timequery_test.py::TimeQueryTest.test_timequery@{"batch_cache":false,"cloud_storage":true,"spillover":true}
tests/rptest/tests/timequery_test.py::TimeQueryTest.test_timequery_with_trim_prefix@{"cloud_storage":true,"spillover":true}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"path"],"test_case":{"name":"(TS_Read == True, TS_Timequery == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[2,"virtual_host"],"test_case":{"name":"(TS_Read == True, TS_TxRangeMaterialized == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"virtual_host"],"test_case":{"name":"(TS_Read == True, TS_TxRangeMaterialized == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/read_replica_e2e_test.py::TestReadReplicaService.test_simple_end_to_end@{"cloud_storage_type_and_url_style":[2,"virtual_host"],"partition_count":10}
tests/rptest/tests/archive_retention_test.py::CloudArchiveRetentionTest.test_delete@{"cloud_storage_type":1,"retention_type":"retention.ms"}
tests/rptest/tests/cloud_storage_scrubber_test.py::CloudStorageScrubberTest.test_scrubber@{"cloud_storage_type":2}
tests/rptest/tests/e2e_shadow_indexing_test.py::EndToEndShadowIndexingTest.test_reset_spillover@{"cloud_storage_type":2}
tests/rptest/tests/offset_for_leader_epoch_archival_test.py::OffsetForLeaderEpochArchivalTest.test_querying_archive
tests/rptest/tests/topic_delete_test.py::TopicDeleteCloudStorageTest.drop_lifecycle_marker_test@{"cloud_storage_type":2}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[2,"virtual_host"],"test_case":{"name":"(TS_Read == True, TS_Timequery == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"virtual_host"],"test_case":{"name":"(TS_Read == True, TS_Timequery == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"path"],"test_case":{"name":"(TS_Read == True, TS_TxRangeMaterialized == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/read_replica_e2e_test.py::TestReadReplicaService.test_partition_movement@{"partition_count":10}
tests/rptest/tests/archive_retention_test.py::CloudArchiveRetentionTest.test_delete@{"cloud_storage_type":1,"retention_type":"retention.bytes"}
tests/rptest/tests/datalake/blocked_catalog_test.py::DatalakeBlockedCatalogTest.test_block_cloud_retention_before_translation@{"cloud_storage_type":1,"with_spillover":true}
tests/rptest/tests/e2e_shadow_indexing_test.py::EndToEndShadowIndexingTest.test_reset_from_cloud@{"cloud_storage_type":1}
tests/rptest/tests/e2e_shadow_indexing_test.py::EndToEndSpilloverTest.test_spillover@{"cloud_storage_type":1}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[2,"virtual_host"],"test_case":{"name":"(TS_Read == True, AdjacentSegmentMergerReupload == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"path"],"test_case":{"name":"(TS_Delete == True, SpilloverManifestUploaded == True, TS_Spillover_ManifestDeleted == True)"}}
tests/rptest/tests/timequery_test.py::TimeQueryTest.test_timequery_with_spillover_gc_delayed
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"virtual_host"],"test_case":{"name":"(TS_Read == True, AdjacentSegmentMergerReupload == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/tiered_storage_model_test.py::TieredStorageTest.test_tiered_storage@{"cloud_storage_type_and_url_style":[1,"path"],"test_case":{"name":"(TS_Read == True, SpilloverManifestUploaded == True)"}}
tests/rptest/tests/cloud_storage_timing_stress_test.py::CloudStorageTimingStressTest.test_cloud_storage@{"cleanup_policy":"compact,delete"}
tests/rptest/tests/topic_delete_test.py::TopicDeleteCloudStorageTest.topic_delete_cloud_storage_test@{"cloud_storage_type":1,"disable_delete":true}
tests/rptest/tests/cloud_storage_timing_stress_test.py::CloudStorageTimingStressTest.test_cloud_storage@{"cleanup_policy":"delete"}
tests/rptest/tests/topic_delete_test.py::TopicDeleteCloudStorageTest.topic_delete_cloud_storage_test@{"cloud_storage_type":2,"disable_delete":false}
tests/rptest/tests/cloud_storage_timing_stress_test.py::CloudStorageTimingStressTest.test_cloud_storage_with_partition_moves@{"cleanup_policy":"delete"}
tests/rptest/tests/topic_delete_test.py::TopicDeleteCloudStorageTest.topic_delete_cloud_storage_test@{"cloud_storage_type":2,"disable_delete":true}
tests/rptest/tests/topic_delete_test.py::TopicDeleteCloudStorageTest.topic_delete_unavailable_test@{"cloud_storage_type":1}
tests/rptest/tests/data_migrations_api_test.py::DataMigrationsApiTest.test_conflicting_names

vbotbuildovich avatar Apr 29 '25 12:04 vbotbuildovich

Retry command for Build#65262

please wait until all jobs are finished before running the slash command



/ci-repeat 1
tests/rptest/tests/crl_test.py::CertificateRevocationTest.test_rpc
tests/rptest/tests/data_migrations_api_test.py::DataMigrationsApiTest.test_conflicting_names
tests/rptest/tests/simple_e2e_test.py::SimpleEndToEndTest.test_consumer_interruption

vbotbuildovich avatar Apr 30 '25 00:04 vbotbuildovich

/ci-repeat 1 tests/rptest/tests/crl_test.py::CertificateRevocationTest.test_rpc tests/rptest/tests/data_migrations_api_test.py::DataMigrationsApiTest.test_conflicting_names tests/rptest/tests/simple_e2e_test.py::SimpleEndToEndTest.test_consumer_interruption

Lazin avatar May 08 '25 08:05 Lazin

format and rebase in force push

Lazin avatar Sep 12 '25 12:09 Lazin

force push: removed last two commits that add fix for the problem which is no longer present in the code base

Lazin avatar Sep 12 '25 15:09 Lazin

/backport v25.1.x

vbotbuildovich avatar Sep 15 '25 10:09 vbotbuildovich

/backport v24.3.x

vbotbuildovich avatar Sep 15 '25 10:09 vbotbuildovich

/backport v25.2.x

Lazin avatar Sep 15 '25 10:09 Lazin

Oops! Something went wrong.

Workflow run logs.

vbotbuildovich avatar Sep 15 '25 10:09 vbotbuildovich