rpk: migrate namespace to resource group
This PR updates the Cloud's Namespace field to use Resource Group in the rpk codebase where we use the Public API.
This includes bumping the Cloud's Public API from v1Beta1 to v1Beta2, and bumping the rpk.yaml's version.
The PR also renames rpk cloud namespace to rpk cloud resource-group, but remember that this was a hidden and undocumented command. Namespace still works as an alias.
Backports Required
- [ ] none - not a bug fix
- [ ] none - this is a backport
- [X] none - issue does not exist in previous branches
- [ ] none - papercut/not impactful enough to backport
- [ ] v24.1.x
- [ ] v23.3.x
- [ ] v23.2.x
Release Notes
- none
new failures in https://buildkite.com/redpanda/redpanda/builds/48580#018f365b-36cd-46b3-8fe3-cda17f2faf36:
"rptest.tests.read_replica_e2e_test.ReadReplicasUpgradeTest.test_upgrades.cloud_storage_type=CloudStorageType.S3"
new failures in https://buildkite.com/redpanda/redpanda/builds/48580#018f365b-36d0-45dd-bf36-a4d1a4178b46:
"rptest.tests.upgrade_test.UpgradeFromPriorFeatureVersionCloudStorageTest.test_rolling_upgrade.cloud_storage_type=CloudStorageType.S3"
new failures in https://buildkite.com/redpanda/redpanda/builds/48580#018f3662-1b23-4685-8250-4c4503ec8844:
"rptest.tests.read_replica_e2e_test.ReadReplicasUpgradeTest.test_upgrades.cloud_storage_type=CloudStorageType.S3"
"rptest.tests.partition_movement_test.SIPartitionMovementTest.test_cross_shard.num_to_upgrade=2.cloud_storage_type=CloudStorageType.S3"
"rptest.tests.partition_movement_test.SIPartitionMovementTest.test_shadow_indexing.num_to_upgrade=2.cloud_storage_type=CloudStorageType.S3"
new failures in https://buildkite.com/redpanda/redpanda/builds/48580#018f3662-1b2a-407e-9dcc-84fdb9df871d:
"rptest.tests.upgrade_test.UpgradeFromPriorFeatureVersionCloudStorageTest.test_rolling_upgrade.cloud_storage_type=CloudStorageType.S3"
Adds back the namespace field and adds a migration mechanism for profiles that have the "namespace" value.