redpanda
redpanda copied to clipboard
Published
20 hours ago •
redpanda-data
redpanda-data
CI Failure (key symptom) in `SimpleSelfTest.test_cloud`
https://buildkite.com/redpanda/vtools/builds/10750 https://buildkite.com/redpanda/vtools/builds/11057
Module: rptest.tests.services_self_test
Class: SimpleSelfTest
Method: test_cloud
test_id: SimpleSelfTest.test_cloud
status: FAIL
run time: 57.876 seconds
RpkException('command /opt/redpanda/bin/rpk cloud byoc gcp apply --redpanda-id=clfhdljruq7ct96ca2n0 --project-id=devprod-cicd-infra -v returned 1, output: ', '2023-11-23T09:09:50.927Z\t\x1b[34mINFO\x1b[0m\t.rpk.managed-byoc\tcli/validate.go:69\tChecking project... PASSED\n2023-11-23T09:09:51.643Z\t\x1b[34mINFO\x1b[0m\t.rpk.managed-byoc\tgcp/apply.go:73\tReconciling agent infrastructure...\n2023-11-23T09:09:51.875Z\t\x1b[34mINFO\x1b[0m\t.rpk.managed-byoc\tcli/cli.go:190\tRunning apply\t{"provisioner": "bootstrap"}\n2023-11-23T09:09:57.655Z\t\x1b[34mINFO\x1b[0m\t.rpk.managed-byoc\tcli/cli.go:200\tFinished apply\t{"provisioner": "bootstrap"}\n2023-11-23T09:09:57.655Z\t\x1b[34mINFO\x1b[0m\t.rpk.managed-byoc\tcli/cli.go:190\tRunning apply\t{"provisioner": "network"}\n2023-11-23T09:10:16.600Z\t\x1b[31mERROR\x1b[0m\t.rpk.managed-byoc\tcli/cli.go:193\tFailed to apply provisioner\t{"provisioner": "network", "error": "failed running terraform apply: exit status 1\\n\\nError: Error waiting to create Network: Error waiting for Creating Network: Quota \'NETWORKS\' exceeded. Limit: 30.0 globally.\\n\\tmetric name = compute.googleapis.com/networks\\n\\tlimit name = NETWORKS-per-project\\n\\tlimit = 30\\n\\tdimensions = map[global:global]\\n\\n\\n with google_compute_network.redpanda[0],\\n on main.tf line 53, in resource \\"google_compute_network\\" \\"redpanda\\":\\n 53: resource \\"google_compute_network\\" \\"redpanda\\" {\\n\\n"}\nFailed to apply provisioners: failed to apply provisioner network: failed running terraform apply: exit status 1\n\nError: Error waiting to create Network: Error waiting for Creating Network: Quota \'NETWORKS\' exceeded. Limit: 30.0 globally.\n\tmetric name = compute.googleapis.com/networks\n\tlimit name = NETWORKS-per-project\n\tlimit = 30\n\tdimensions = map[global:global]\n\n\n with google_compute_network.redpanda[0],\n on main.tf line 53, in resource "google_compute_network" "redpanda":\n 53: resource "google_compute_network" "redpanda" {\n\n\n', 1, '')
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 182, in _do_run
self.setup_test()
File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/runner_client.py", line 260, in setup_test
self.test.setup()
File "/usr/local/lib/python3.10/dist-packages/ducktape/tests/test.py", line 91, in setup
self.setUp()
File "/home/ubuntu/redpanda/tests/rptest/tests/services_self_test.py", line 250, in setUp
self.redpanda.start()
File "/home/ubuntu/redpanda/tests/rptest/services/redpanda.py", line 1550, in start
cluster_id = self._cloud_cluster.create(superuser=superuser)
File "/home/ubuntu/redpanda/tests/rptest/services/redpanda_cloud.py", line 831, in create
self._create_new_cluster()
File "/home/ubuntu/redpanda/tests/rptest/services/redpanda_cloud.py", line 679, in _create_new_cluster
self.utils.rpk_cloud_apply(_cluster_id)
File "/home/ubuntu/redpanda/tests/rptest/services/cloud_cluster_utils.py", line 132, in rpk_cloud_apply
out = self._exec(cmd, timeout=1800)
File "/home/ubuntu/redpanda/tests/rptest/services/cloud_cluster_utils.py", line 103, in _exec
return self.rpk._execute(cmd, env=self.env, timeout=timeout)
File "/home/ubuntu/redpanda/tests/rptest/clients/rpk.py", line 1067, in _execute
raise RpkException(
rptest.clients.rpk.RpkException: RpkException<command /opt/redpanda/bin/rpk cloud byoc gcp apply --redpanda-id=clfhdljruq7ct96ca2n0 --project-id=devprod-cicd-infra -v returned 1, output: ; stderr: 2023-11-23T09:09:50.927Z [34mINFO[0m .rpk.managed-byoc cli/validate.go:69 Checking project... PASSED
2023-11-23T09:09:51.643Z [34mINFO[0m .rpk.managed-byoc gcp/apply.go:73 Reconciling agent infrastructure...
2023-11-23T09:09:51.875Z [34mINFO[0m .rpk.managed-byoc cli/cli.go:190 Running apply {"provisioner": "bootstrap"}
2023-11-23T09:09:57.655Z [34mINFO[0m .rpk.managed-byoc cli/cli.go:200 Finished apply {"provisioner": "bootstrap"}
2023-11-23T09:09:57.655Z [34mINFO[0m .rpk.managed-byoc cli/cli.go:190 Running apply {"provisioner": "network"}
2023-11-23T09:10:16.600Z [31mERROR[0m .rpk.managed-byoc cli/cli.go:193 Failed to apply provisioner {"provisioner": "network", "error": "failed running terraform apply: exit status 1\n\nError: Error waiting to create Network: Error waiting for Creating Network: Quota 'NETWORKS' exceeded. Limit: 30.0 globally.\n\tmetric name = compute.googleapis.com/networks\n\tlimit name = NETWORKS-per-project\n\tlimit = 30\n\tdimensions = map[global:global]\n\n\n with google_compute_network.redpanda[0],\n on main.tf line 53, in resource \"google_compute_network\" \"redpanda\":\n 53: resource \"google_compute_network\" \"redpanda\" {\n\n"}
Failed to apply provisioners: failed to apply provisioner network: failed running terraform apply: exit status 1
Error: Error waiting to create Network: Error waiting for Creating Network: Quota 'NETWORKS' exceeded. Limit: 30.0 globally.
metric name = compute.googleapis.com/networks
limit name = NETWORKS-per-project
limit = 30
dimensions = map[global:global]
with google_compute_network.redpanda[0],
on main.tf line 53, in resource "google_compute_network" "redpanda":
53: resource "google_compute_network" "redpanda" {
; returncode: 1>
*https://buildkite.com/redpanda/vtools/builds/11776 *https://buildkite.com/redpanda/vtools/builds/11796 *https://buildkite.com/redpanda/vtools/builds/11821 *https://buildkite.com/redpanda/vtools/builds/11837
*https://buildkite.com/redpanda/vtools/builds/12529 *https://buildkite.com/redpanda/vtools/builds/12533
*https://buildkite.com/redpanda/vtools/builds/12676 *https://buildkite.com/redpanda/vtools/builds/12677 *https://buildkite.com/redpanda/vtools/builds/12680 *https://buildkite.com/redpanda/vtools/builds/12691 *https://buildkite.com/redpanda/vtools/builds/12710 *https://buildkite.com/redpanda/vtools/builds/12697 *https://buildkite.com/redpanda/vtools/builds/12680
*https://buildkite.com/redpanda/vtools/builds/12730 *https://buildkite.com/redpanda/vtools/builds/12731 *https://buildkite.com/redpanda/vtools/builds/12735 *https://buildkite.com/redpanda/vtools/builds/12734 *https://buildkite.com/redpanda/vtools/builds/12737
