redpanda
redpanda copied to clipboard
c/controller_backend: bootstrap from shard_placement_table
When bootstrapping controller_backend, we don't really need to try and reconcile all ntps in the cluster, we can start with the set that is in shard_placement_table (i.e. all ntps with some relation to the current shard). This also allows us to use non-consuming topic_table notifications.
Backports Required
- [x] none - not a bug fix
- [ ] none - this is a backport
- [ ] none - issue does not exist in previous branches
- [ ] none - papercut/not impactful enough to backport
- [ ] v24.1.x
- [ ] v23.3.x
- [ ] v23.2.x
Release Notes
- none
new failures in https://buildkite.com/redpanda/redpanda/builds/48324#018f1a86-58bf-43f3-b708-89395e480aba:
"rptest.tests.cloud_storage_scrubber_test.CloudStorageScrubberTest.test_scrubber.cloud_storage_type=CloudStorageType.ABS"
new failures in https://buildkite.com/redpanda/redpanda/builds/48349#018f1bc6-0512-41f0-a7bd-855763e6c740:
"rptest.tests.node_pool_migration_test.NodePoolMigrationTest.test_migrating_redpanda_nodes_to_new_pool.balancing_mode=off.test_mode=TestMode.FAST_MOVES.cleanup_policy=compact.delete"
"rptest.tests.node_pool_migration_test.NodePoolMigrationTest.test_migrating_redpanda_nodes_to_new_pool.balancing_mode=node_add.test_mode=TestMode.NO_TIRED_STORAGE.cleanup_policy=compact.delete"
"rptest.tests.cluster_config_test.ClusterConfigTest.test_abs_cloud_validation.update_str=ABS_VM_INSTANCE_METADATA"
"rptest.tests.cluster_config_test.ClusterConfigTest.test_rpk_lint"
"rptest.tests.cluster_features_test.FeaturesUpgradeActivationTest.test_policy_change_in_minor_release.disable=False"
"rptest.tests.retention_policy_test.ShadowIndexingCloudRetentionTest.test_cloud_size_based_retention_application.cloud_storage_type=CloudStorageType.S3"
"rptest.tests.node_pool_migration_test.NodePoolMigrationTest.test_migrating_redpanda_nodes_to_new_pool.balancing_mode=off.test_mode=TestMode.TIRED_STORAGE.cleanup_policy=compact.delete"
"rptest.tests.partition_force_reconfiguration_test.PartitionForceReconfigurationTest.test_basic_reconfiguration.acks=-1.restart=True.controller_snapshots=True"
"rptest.tests.partition_force_reconfiguration_test.PartitionForceReconfigurationTest.test_basic_reconfiguration.acks=1.restart=True.controller_snapshots=True"
"rptest.tests.cloud_storage_scrubber_test.CloudStorageScrubberTest.test_scrubber.cloud_storage_type=CloudStorageType.ABS"
new failures in https://buildkite.com/redpanda/redpanda/builds/48401#018f26b7-f3b7-4b8d-8357-0e08fe9d8a63:
"rptest.tests.partition_move_interruption_test.PartitionMoveInterruption.test_cancelling_partition_move.replication_factor=1.unclean_abort=False.recovery=restart_recovery.compacted=False"
Failure is https://github.com/redpanda-data/redpanda/issues/17535
Failure is https://github.com/redpanda-data/redpanda/issues/14149