cryostat-operator
cryostat-operator copied to clipboard
Published
20 hours ago •
cryostatio
cryostatio
[Bug] Scorecard test suite failures for Cryostat 3.0
Directions for running tests:
$ export IMAGE_NAMESPACE=quay.io/mynamespace
$ make custom-scorecard-tests
$ make scorecard-build
$ make generate manifests manager oci-build bundle bundle-build
$ podman push $IMAGE_NAMESPACE/cryostat-operator-bundle:3.0.0-dev
$ podman push $IMAGE_NAMESPACE/cryostat-operator:3.0.0-dev
$ podman image prune -f
Summary
| Test Name | Status |
|---|---|
| cryostat-install | OK - seems to pass |
| cryostat-cr | OK - seems to pass |
| cryostat-multi-namespace | OK - seems to pass |
| cryostat-recording | Fail - timeout |
| cryostat-config-change | Fail - timeout |
| cryostat-report | "Passes" with wrong-looking log output |
Results
cryostat-install
Tests runs and passes. Need to validate that the expectations/assertions still make sense.
cryostat-cr
Tests runs and passes. Need to validate that the expectations/assertions still make sense.
cryostat-multi-namespace
Tests runs and passes. Need to validate that the expectations/assertions still make sense.
cryostat-recording
Fails and times out.
NAMESPACE: CRYOSTAT-OPERATOR-SCORECARD
POD: CRYOSTAT-RECORDING-56FC8D4D65-TL86W
CONTAINER: CRYOSTAT-RECORDING
LOG:
Importing certificate /truststore/operator/..2024_05_09_19_17_40.546859402/cryostat-recording-ca.crt ...
Certificate was added to keystore
[Storing /opt/cryostat.d/truststore.p12]
INFO exec -a "java" java -XX:MaxRAMPercentage=80.0 -XX:+UseParallelGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -XX:+ExitOnOutOfMemoryError -Dquarkus.http.host=0.0.0.0 -Djava.util.logging.manager=org.jboss.logmanager.LogManager -Djavax.net.ssl.trustStore=/opt/cryostat.d/truststore.p12 -Djavax.net.ssl.trustStorePassword=M6wI5FM2RzwUsMYfRayZQX9nRzDibvdw -Dcom.sun.management.jmxremote.authenticate=true -Dcom.sun.management.jmxremote.password.file=/tmp/jmxremote.password -Dcom.sun.management.jmxremote.access.file=/tmp/jmxremote.access -cp "." -jar /deployments/quarkus-run.jar
INFO running in /deployments
__ ____ __ _____ ___ __ ____ ______
--/ __ \/ / / / _ | / _ \/ //_/ / / / __/
-/ /_/ / /_/ / __ |/ , _/ ,< / /_/ /\ \
--\___\_\____/_/ |_/_/|_/_/|_|\____/___/
2024-05-09 19:18:00,297 INFO [io.und.websockets] (main) UT026003: Adding annotated server endpoint class io.cryostat.ws.MessagingServer for path /api/notifications
2024-05-09 19:18:01,849 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,849 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "activerecording" does not exist, skipping
2024-05-09 19:18:01,850 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,850 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "credential" does not exist, skipping
2024-05-09 19:18:01,851 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,851 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "discoverynode" does not exist, skipping
2024-05-09 19:18:01,851 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,851 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "discoveryplugin" does not exist, skipping
2024-05-09 19:18:01,852 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,852 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "discoveryplugin" does not exist, skipping
2024-05-09 19:18:01,852 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,853 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "rule" does not exist, skipping
2024-05-09 19:18:01,853 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,853 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "target" does not exist, skipping
2024-05-09 19:18:01,854 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,854 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "activerecording" does not exist, skipping
2024-05-09 19:18:01,854 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,855 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "credential" does not exist, skipping
2024-05-09 19:18:01,855 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,855 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "discoverynode" does not exist, skipping
2024-05-09 19:18:01,855 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,856 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "discoveryplugin" does not exist, skipping
2024-05-09 19:18:01,856 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,856 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "matchexpression" does not exist, skipping
2024-05-09 19:18:01,857 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,857 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "rule" does not exist, skipping
2024-05-09 19:18:01,857 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,857 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "target" does not exist, skipping
2024-05-09 19:18:01,858 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,858 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "activerecording_seq" does not exist, skipping
2024-05-09 19:18:01,858 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,858 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "credential_seq" does not exist, skipping
2024-05-09 19:18:01,859 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,859 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "discoverynode_seq" does not exist, skipping
2024-05-09 19:18:01,859 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,859 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "matchexpression_seq" does not exist, skipping
2024-05-09 19:18:01,860 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,860 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "rule_seq" does not exist, skipping
2024-05-09 19:18:01,860 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:18:01,860 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "target_seq" does not exist, skipping
2024-05-09 19:18:02,465 INFO [io.cry.dis.KubeApiDiscovery] (main) Starting KubernetesApi client
2024-05-09 19:18:02,504 INFO [io.cry.StorageBuckets] (main) Checking if storage bucket "probes" exists ...
2024-05-09 19:18:03,347 INFO [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:18:03,347 INFO [io.cry.StorageBuckets] (main) Attempting to create storage bucket "probes" ...
2024-05-09 19:18:03,541 ERROR [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:18:04,062 INFO [io.cry.dis.KubeApiDiscovery] (main) Started Endpoints SharedInformer for namespace "cryostat-operator-scorecard"
2024-05-09 19:18:04,065 INFO [io.cry.StorageBuckets] (main) Checking if storage bucket "archivedreports" exists ...
2024-05-09 19:18:04,418 INFO [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:18:04,418 INFO [io.cry.StorageBuckets] (main) Attempting to create storage bucket "archivedreports" ...
2024-05-09 19:18:04,582 ERROR [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:18:04,605 INFO [io.cry.StorageBuckets] (main) Checking if storage bucket "archivedrecordings" exists ...
2024-05-09 19:18:04,899 INFO [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:18:04,899 INFO [io.cry.StorageBuckets] (main) Attempting to create storage bucket "archivedrecordings" ...
2024-05-09 19:18:05,179 ERROR [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:18:05,180 INFO [io.cry.StorageBuckets] (main) Checking if storage bucket "eventtemplates" exists ...
2024-05-09 19:18:05,476 INFO [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:18:05,476 INFO [io.cry.StorageBuckets] (main) Attempting to create storage bucket "eventtemplates" ...
2024-05-09 19:18:05,544 ERROR [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:18:05,646 INFO [io.quarkus] (main) cryostat3 3.0.0-snapshot on JVM (powered by Quarkus 3.2.12.Final) started in 6.851s. Listening on: http://0.0.0.0:8181
2024-05-09 19:18:05,646 INFO [io.quarkus] (main) Profile prod activated.
2024-05-09 19:18:05,647 INFO [io.quarkus] (main) Installed features: [agroal, amazon-s3, cache, cdi, hibernate-orm, hibernate-orm-panache, hibernate-validator, jdbc-postgresql, narayana-jta, quartz, quinoa, rest-client-reactive, rest-client-reactive-jackson, resteasy-reactive, resteasy-reactive-jackson, scheduler, smallrye-context-propagation, smallrye-graphql, smallrye-openapi, vertx, websockets, websockets-client]
2024-05-09 19:18:08,230 INFO [io.qua.htt.access-log] (executor-thread-1) 10.129.0.2 - - [09/May/2024:19:18:08 +0000] "GET /health/liveness HTTP/1.1" 204 -
2024-05-09 19:18:18,053 INFO [io.qua.htt.access-log] (executor-thread-1) 10.129.0.2 - - [09/May/2024:19:18:18 +0000] "GET /health/liveness HTTP/1.1" 204 -
2024-05-09 19:18:28,054 INFO [io.qua.htt.access-log] (executor-thread-1) 10.129.0.2 - - [09/May/2024:19:18:28 +0000] "GET /health/liveness HTTP/1.1" 204 -
2024-05-09 19:18:28,537 INFO [io.qua.htt.access-log] (executor-thread-1) 34.196.240.194 - - [09/May/2024:19:18:28 +0000] "GET /health HTTP/1.1" 200 196
2024-05-09 19:18:29,085 WARN [io.cry.cor.net.JFRConnectionToolkit] (executor-thread-1) connection attempt failed.
... trimmed lots of healthcheck probe logs ...
2024-05-09 19:28:28,051 INFO [io.qua.htt.access-log] (executor-thread-11) 10.129.0.2 - - [09/May/2024:19:28:28 +0000] "GET /health/liveness HTTP/1.1" 204 -
failed to store logs for container cryostat-recording in pod cryostat-recording-56fc8d4d65-tl86w: context deadline exceeded
NAMESPACE: CRYOSTAT-OPERATOR-SCORECARD
POD: CRYOSTAT-RECORDING-56FC8D4D65-TL86W
CONTAINER: CRYOSTAT-RECORDING-JFR-DATASOURCE
LOG:
INFO exec -a "java" java -XX:MaxRAMPercentage=80.0 -XX:+UseParallelGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -XX:+ExitOnOutOfMemoryError -XX:-ExitOnOutOfMemoryError -Dquarkus.http.host=0.0.0.0 -Djava.util.logging.manager=org.jboss.logmanager.LogManager -cp "." -jar /deployments/quarkus-run.jar
INFO running in /deployments
__ ____ __ _____ ___ __ ____ ______
--/ __ \/ / / / _ | / _ \/ //_/ / / / __/
-/ /_/ / /_/ / __ |/ , _/ ,< / /_/ /\ \
--\___\_\____/_/ |_/_/|_/_/|_|\____/___/
2024-05-09 19:17:55,758 INFO [io.quarkus] (main) jfr-datasource 3.0.0-SNAPSHOT on JVM (powered by Quarkus 3.2.12.Final) started in 1.084s. Listening on: http://0.0.0.0:8989
2024-05-09 19:17:55,808 INFO [io.quarkus] (main) Profile prod activated.
2024-05-09 19:17:55,808 INFO [io.quarkus] (main) Installed features: [cdi, reactive-routes, smallrye-context-propagation, vertx]
failed to store logs for container cryostat-recording-jfr-datasource in pod cryostat-recording-56fc8d4d65-tl86w: context deadline exceeded
INFO[0000] subscription "cryostat-operator-v3-0-0-dev-sub" deleted
INFO[0001] customresourcedefinition "cryostats.operator.cryostat.io" deleted
INFO[0001] clusterserviceversion "cryostat-operator.v3.0.0-dev" deleted
INFO[0001] catalogsource "cryostat-operator-catalog" deleted
INFO[0001] operatorgroup "operator-sdk-og" deleted
INFO[0001] Operator "cryostat-operator" uninstalled
serviceaccount "cryostat-scorecard" deleted
role.rbac.authorization.k8s.io "cryostat-scorecard" deleted
clusterrole.rbac.authorization.k8s.io "cryostat-scorecard" deleted
rolebinding.rbac.authorization.k8s.io "cryostat-scorecard" deleted
clusterrolebinding.rbac.authorization.k8s.io "cryostat-scorecard" deleted
Error from server (NotFound): secrets "registry-key" not found
namespace "cryostat-operator-scorecard" deleted
make: *** [Makefile:185: test-scorecard] Error 1
cryostat-config-change
Fails and times out.
INFO[0010] Creating a File-Based Catalog of the bundle "quay.io/andrewazores/cryostat-operator-bundle:3.0.0-dev"
INFO[0011] Generated a valid File-Based Catalog
INFO[0014] Created registry pod: quay-io-andrewazores-cryostat-operator-bundle-3-0-0-dev
INFO[0014] Created CatalogSource: cryostat-operator-catalog
INFO[0014] OperatorGroup "operator-sdk-og" created
INFO[0014] Created Subscription: cryostat-operator-v3-0-0-dev-sub
INFO[0031] Approved InstallPlan install-76d6f for the Subscription: cryostat-operator-v3-0-0-dev-sub
INFO[0031] Waiting for ClusterServiceVersion "cryostat-operator-scorecard/cryostat-operator.v3.0.0-dev" to reach 'Succeeded' phase
INFO[0031] Waiting for ClusterServiceVersion "cryostat-operator-scorecard/cryostat-operator.v3.0.0-dev" to appear
INFO[0033] Found ClusterServiceVersion "cryostat-operator-scorecard/cryostat-operator.v3.0.0-dev" phase: Pending
INFO[0035] Found ClusterServiceVersion "cryostat-operator-scorecard/cryostat-operator.v3.0.0-dev" phase: InstallReady
INFO[0036] Found ClusterServiceVersion "cryostat-operator-scorecard/cryostat-operator.v3.0.0-dev" phase: Installing
INFO[0046] Found ClusterServiceVersion "cryostat-operator-scorecard/cryostat-operator.v3.0.0-dev" phase: Succeeded
INFO[0046] OLM has successfully installed "cryostat-operator.v3.0.0-dev"
function cleanup { ( set +e; /home/work/bin/operator-sdk cleanup -n cryostat-operator-scorecard cryostat-operator; /home/work/workspace/cryostat-operator/bin/kustomize build internal/images/custom-scorecard-tests/rbac/ | oc delete --ignore-not-found=false -f -; oc delete --ignore-not-found=false -n cryostat-operator-scorecard secret registry-key; oc delete --ignore-not-found=false namespace cryostat-operator-scorecard; ) } ; \
trap cleanup EXIT ; \
/home/work/bin/operator-sdk scorecard -n cryostat-operator-scorecard -s cryostat-scorecard -w 20m quay.io/andrewazores/cryostat-operator-bundle:3.0.0-dev --pod-security=restricted --selector='test in (cryostat-config-change)'
--------------------------------------------------------------------------------
Image: quay.io/andrewazores/cryostat-operator-scorecard:3.0.0-20240509180841
Entrypoint: [cryostat-scorecard-tests cryostat-config-change]
Labels:
"suite":"cryostat"
"test":"cryostat-config-change"
Results:
Name: cryostat-config-change
State: fail
Errors:
failed to reach the application: timed out waiting for the condition
Log:
deployment cryostat-config-change is not yet found
deployment cryostat-config-change is not yet found
deployment cryostat-config-change is not yet found
deployment cryostat-config-change is not yet found
deployment cryostat-config-change is not yet found
deployment cryostat-config-change is not yet found
deployment cryostat-config-change is not yet found
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is not yet available
deployment cryostat-config-change is available
application has access to the following namespaces: [cryostat-operator-scorecard]
application is available at https://cryostat-config-change-cryostat-operator-scorecard.apps.rosa.pg3ns-gtvau-29u.aemu.p3.openshiftapps.com
Cryostat deployment is still updating. Storage: &EmptyDirVolumeSource{Medium:,SizeLimit:0,}
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 new replicas have been updated...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
Waiting for deployment cryostat-config-change rollout to finish: 0 out of 1 updated replicas are available...
deployment cryostat-config-change successfully rolled out
Cryostat deployment has successfully updated with new spec template
base url: https://cryostat-config-change-cryostat-operator-scorecard.apps.rosa.pg3ns-gtvau-29u.aemu.p3.openshiftapps.com
application is not yet ready: report is not available
... trimmed lots of duplicate lines ...
application is not yet ready: report is not available
WORKLOAD EVENTS:
deployment cryostat-config-change conditions:
Available == True, MinimumReplicasAvailable: Deployment has minimum availability.
Progressing == True, NewReplicaSetAvailable: ReplicaSet "cryostat-config-change-59f478f948" has successfully progressed.
deployment cryostat-config-change warning events:
replica set cryostat-config-change-59f478f948 conditions:
replica set cryostat-config-change-59f478f948 warning events:
replica set cryostat-config-change-65dc6df796 conditions:
replica set cryostat-config-change-65dc6df796 warning events:
pod cryostat-config-change-59f478f948-xjq46 phase: Running
pod cryostat-config-change-59f478f948-xjq46 conditions:
Initialized == True, :
Ready == True, :
ContainersReady == True, :
PodScheduled == True, :
pod cryostat-config-change-59f478f948-xjq46 warning events:
Unhealthy: Readiness probe failed: /var/run/postgresql:5432 - no response
INFO[0000] subscription "cryostat-operator-v3-0-0-dev-sub" deleted
INFO[0000] customresourcedefinition "cryostats.operator.cryostat.io" deleted
INFO[0001] clusterserviceversion "cryostat-operator.v3.0.0-dev" deleted
INFO[0001] catalogsource "cryostat-operator-catalog" deleted
INFO[0001] operatorgroup "operator-sdk-og" deleted
INFO[0001] Operator "cryostat-operator" uninstalled
cryostat-report
Test runs and reports success, but log output doesn't look right.
NAMESPACE: CRYOSTAT-OPERATOR-SCORECARD
POD: CRYOSTAT-REPORT-7C8FCB6D99-WSQS7
CONTAINER: CRYOSTAT-REPORT-JFR-DATASOURCE
LOG:
INFO exec -a "java" java -XX:MaxRAMPercentage=80.0 -XX:+UseParallelGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -XX:+ExitOnOutOfMemoryError -XX:-ExitOnOutOfMemoryError -Dquarkus.http.host=0.0.0.0 -Djava.util.logging.manager=org.jboss.logmanager.LogManager -cp "." -jar /deployments/quarkus-run.jar
INFO running in /deployments
__ ____ __ _____ ___ __ ____ ______
--/ __ \/ / / / _ | / _ \/ //_/ / / / __/
-/ /_/ / /_/ / __ |/ , _/ ,< / /_/ /\ \
--\___\_\____/_/ |_/_/|_/_/|_|\____/___/
2024-05-09 19:49:06,809 INFO [io.quarkus] (main) jfr-datasource 3.0.0-SNAPSHOT on JVM (powered by Quarkus 3.2.12.Final) started in 1.855s. Listening on: http://0.0.0.0:8989
2024-05-09 19:49:06,961 INFO [io.quarkus] (main) Profile prod activated.
2024-05-09 19:49:06,962 INFO [io.quarkus] (main) Installed features: [cdi, reactive-routes, smallrye-context-propagation, vertx]
2024-05-09 19:49:31,972 INFO [io.quarkus] (main) jfr-datasource stopped in 0.057s
NAMESPACE: CRYOSTAT-OPERATOR-SCORECARD
POD: CRYOSTAT-REPORT-7C8FCB6D99-WSQS7
CONTAINER: CRYOSTAT-REPORT
LOG:
Importing certificate /truststore/operator/..2024_05_09_19_48_57.3758276736/cryostat-report-ca.crt ...
Certificate was added to keystore
[Storing /opt/cryostat.d/truststore.p12]
INFO exec -a "java" java -XX:MaxRAMPercentage=80.0 -XX:+UseParallelGC -XX:MinHeapFreeRatio=10 -XX:MaxHeapFreeRatio=20 -XX:GCTimeRatio=4 -XX:AdaptiveSizePolicyWeight=90 -XX:+ExitOnOutOfMemoryError -Dquarkus.http.host=0.0.0.0 -Djava.util.logging.manager=org.jboss.logmanager.LogManager -Djavax.net.ssl.trustStore=/opt/cryostat.d/truststore.p12 -Djavax.net.ssl.trustStorePassword=M6wI5FM2RzwUsMYfRayZQX9nRzDibvdw -Dcom.sun.management.jmxremote.authenticate=true -Dcom.sun.management.jmxremote.password.file=/tmp/jmxremote.password -Dcom.sun.management.jmxremote.access.file=/tmp/jmxremote.access -cp "." -jar /deployments/quarkus-run.jar
INFO running in /deployments
__ ____ __ _____ ___ __ ____ ______
--/ __ \/ / / / _ | / _ \/ //_/ / / / __/
-/ /_/ / /_/ / __ |/ , _/ ,< / /_/ /\ \
--\___\_\____/_/ |_/_/|_/_/|_|\____/___/
2024-05-09 19:49:07,725 INFO [io.und.websockets] (main) UT026003: Adding annotated server endpoint class io.cryostat.ws.MessagingServer for path /api/notifications
2024-05-09 19:49:09,344 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,344 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "activerecording" does not exist, skipping
2024-05-09 19:49:09,344 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,345 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "credential" does not exist, skipping
2024-05-09 19:49:09,345 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,345 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "discoverynode" does not exist, skipping
2024-05-09 19:49:09,346 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,346 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "discoveryplugin" does not exist, skipping
2024-05-09 19:49:09,346 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,346 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "discoveryplugin" does not exist, skipping
2024-05-09 19:49:09,347 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,347 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "rule" does not exist, skipping
2024-05-09 19:49:09,347 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,347 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) relation "target" does not exist, skipping
2024-05-09 19:49:09,348 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,348 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "activerecording" does not exist, skipping
2024-05-09 19:49:09,348 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,348 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "credential" does not exist, skipping
2024-05-09 19:49:09,349 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,349 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "discoverynode" does not exist, skipping
2024-05-09 19:49:09,349 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,349 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "discoveryplugin" does not exist, skipping
2024-05-09 19:49:09,350 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,350 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "matchexpression" does not exist, skipping
2024-05-09 19:49:09,350 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,350 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "rule" does not exist, skipping
2024-05-09 19:49:09,351 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,351 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) table "target" does not exist, skipping
2024-05-09 19:49:09,351 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,351 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "activerecording_seq" does not exist, skipping
2024-05-09 19:49:09,352 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,352 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "credential_seq" does not exist, skipping
2024-05-09 19:49:09,353 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,353 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "discoverynode_seq" does not exist, skipping
2024-05-09 19:49:09,353 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,353 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "matchexpression_seq" does not exist, skipping
2024-05-09 19:49:09,354 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,354 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "rule_seq" does not exist, skipping
2024-05-09 19:49:09,354 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) SQL Warning Code: 0, SQLState: 00000
2024-05-09 19:49:09,354 WARN [org.hib.eng.jdb.spi.SqlExceptionHelper] (JPA Startup Thread) sequence "target_seq" does not exist, skipping
2024-05-09 19:49:09,925 INFO [io.cry.dis.KubeApiDiscovery] (main) Starting KubernetesApi client
2024-05-09 19:49:09,975 INFO [io.cry.StorageBuckets] (main) Checking if storage bucket "probes" exists ...
2024-05-09 19:49:11,104 INFO [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:49:11,104 INFO [io.cry.StorageBuckets] (main) Attempting to create storage bucket "probes" ...
2024-05-09 19:49:11,697 ERROR [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:49:12,242 INFO [io.cry.dis.KubeApiDiscovery] (main) Started Endpoints SharedInformer for namespace "cryostat-operator-scorecard"
2024-05-09 19:49:12,246 INFO [io.cry.StorageBuckets] (main) Checking if storage bucket "archivedreports" exists ...
2024-05-09 19:49:12,774 INFO [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:49:12,774 INFO [io.cry.StorageBuckets] (main) Attempting to create storage bucket "archivedreports" ...
2024-05-09 19:49:13,062 ERROR [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:49:13,095 INFO [io.cry.StorageBuckets] (main) Checking if storage bucket "archivedrecordings" exists ...
2024-05-09 19:49:13,478 INFO [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:49:13,478 INFO [io.cry.StorageBuckets] (main) Attempting to create storage bucket "archivedrecordings" ...
2024-05-09 19:49:13,605 ERROR [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:49:13,606 INFO [io.cry.StorageBuckets] (main) Checking if storage bucket "eventtemplates" exists ...
2024-05-09 19:49:14,085 INFO [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:49:14,085 INFO [io.cry.StorageBuckets] (main) Attempting to create storage bucket "eventtemplates" ...
2024-05-09 19:49:14,356 ERROR [io.cry.StorageBuckets] (main) software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: Connection refused
2024-05-09 19:49:14,460 INFO [io.quarkus] (main) cryostat3 3.0.0-snapshot on JVM (powered by Quarkus 3.2.12.Final) started in 9.902s. Listening on: http://0.0.0.0:8181
2024-05-09 19:49:14,461 INFO [io.quarkus] (main) Profile prod activated.
2024-05-09 19:49:14,461 INFO [io.quarkus] (main) Installed features: [agroal, amazon-s3, cache, cdi, hibernate-orm, hibernate-orm-panache, hibernate-validator, jdbc-postgresql, narayana-jta, quartz, quinoa, rest-client-reactive, rest-client-reactive-jackson, resteasy-reactive, resteasy-reactive-jackson, scheduler, smallrye-context-propagation, smallrye-graphql, smallrye-openapi, vertx, websockets, websockets-client]
2024-05-09 19:49:21,113 INFO [io.qua.htt.access-log] (executor-thread-2) 10.130.0.2 - - [09/May/2024:19:49:21 +0000] "GET /health/liveness HTTP/1.1" 204 -
2024-05-09 19:49:30,977 INFO [io.qua.htt.access-log] (executor-thread-2) 10.130.0.2 - - [09/May/2024:19:49:30 +0000] "GET /health/liveness HTTP/1.1" 204 -
2024-05-09 19:49:31,395 WARN [io.cry.dis.KubeApiDiscovery] (executor-thread-1) Target conversion exception: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: GET at: https://172.30.0.1:443/api/v1/namespaces/cryostat-operator-scorecard/pods/cryostat-report-7c8fcb6d99-wsqs7. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. pods "cryostat-report-7c8fcb6d99-wsqs7" is forbidden: User "system:serviceaccount:cryostat-operator-scorecard:cryostat-report" cannot get resource "pods" in API group "" in the namespace "cryostat-operator-scorecard".
at io.fabric8.kubernetes.client.KubernetesClientException.copyAsCause(KubernetesClientException.java:238)
at io.fabric8.kubernetes.client.dsl.internal.OperationSupport.waitForResult(OperationSupport.java:518)
at io.fabric8.kubernetes.client.dsl.internal.OperationSupport.handleResponse(OperationSupport.java:535)
at io.fabric8.kubernetes.client.dsl.internal.OperationSupport.handleGet(OperationSupport.java:478)
at io.fabric8.kubernetes.client.dsl.internal.BaseOperation.handleGet(BaseOperation.java:741)
at io.fabric8.kubernetes.client.dsl.internal.BaseOperation.requireFromServer(BaseOperation.java:185)
at io.fabric8.kubernetes.client.dsl.internal.BaseOperation.get(BaseOperation.java:141)
at io.fabric8.kubernetes.client.dsl.internal.BaseOperation.get(BaseOperation.java:92)
at io.cryostat.discovery.KubeDiscoveryNodeType.lambda$static$15(KubeApiDiscovery.java:680)
at io.cryostat.discovery.KubeApiDiscovery.queryForNode(KubeApiDiscovery.java:471)
at io.cryostat.discovery.KubeApiDiscovery$TargetTuple.toTarget(KubeApiDiscovery.java:630)
at io.cryostat.discovery.KubeApiDiscovery.lambda$handleObservedEndpoints$7(KubeApiDiscovery.java:308)
at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
at java.base/java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:179)
at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625)
at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:762)
at java.base/java.util.stream.ReferencePipeline$7$1.accept(ReferencePipeline.java:276)
at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:197)
at java.base/java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1625)
at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:509)
at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499)
at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)
at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:682)
at io.cryostat.discovery.KubeApiDiscovery.handleObservedEndpoints(KubeApiDiscovery.java:315)
at io.cryostat.discovery.KubeApiDiscovery$EndpointsHandler.lambda$onUpdate$1(KubeApiDiscovery.java:573)
at io.quarkus.narayana.jta.TransactionRunnerImpl.lambda$run$0(TransactionRunnerImpl.java:27)
at io.quarkus.narayana.jta.QuarkusTransactionImpl.callInOurTx(QuarkusTransactionImpl.java:136)
at io.quarkus.narayana.jta.QuarkusTransactionImpl.callJoinExisting(QuarkusTransactionImpl.java:79)
at io.quarkus.narayana.jta.QuarkusTransactionImpl.call(QuarkusTransactionImpl.java:33)
at io.quarkus.narayana.jta.TransactionRunnerImpl.run(TransactionRunnerImpl.java:26)
at io.cryostat.discovery.KubeApiDiscovery$EndpointsHandler.onUpdate(KubeApiDiscovery.java:573)
at io.cryostat.discovery.KubeApiDiscovery$EndpointsHandler.onUpdate(KubeApiDiscovery.java:556)
at io.fabric8.kubernetes.client.informers.impl.cache.ProcessorListener$UpdateNotification.handle(ProcessorListener.java:92)
at io.fabric8.kubernetes.client.informers.impl.cache.ProcessorListener.add(ProcessorListener.java:50)
at io.fabric8.kubernetes.client.informers.impl.cache.SharedProcessor.lambda$distribute$0(SharedProcessor.java:91)
at io.fabric8.kubernetes.client.informers.impl.cache.SharedProcessor.lambda$distribute$1(SharedProcessor.java:114)
at io.fabric8.kubernetes.client.utils.internal.SerialExecutor.lambda$execute$0(SerialExecutor.java:58)
at io.quarkus.vertx.core.runtime.VertxCoreRecorder$14.runWith(VertxCoreRecorder.java:581)
at org.jboss.threads.EnhancedQueueExecutor$Task.run(EnhancedQueueExecutor.java:2513)
at org.jboss.threads.EnhancedQueueExecutor$ThreadBody.run(EnhancedQueueExecutor.java:1538)
at org.jboss.threads.DelegatingRunnable.run(DelegatingRunnable.java:29)
at org.jboss.threads.ThreadLocalResettingRunnable.run(ThreadLocalResettingRunnable.java:29)
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
at java.base/java.lang.Thread.run(Thread.java:840)
Caused by: io.fabric8.kubernetes.client.KubernetesClientException: Failure executing: GET at: https://172.30.0.1:443/api/v1/namespaces/cryostat-operator-scorecard/pods/cryostat-report-7c8fcb6d99-wsqs7. Message: Forbidden!Configured service account doesn't have access. Service account may have been revoked. pods "cryostat-report-7c8fcb6d99-wsqs7" is forbidden: User "system:serviceaccount:cryostat-operator-scorecard:cryostat-report" cannot get resource "pods" in API group "" in the namespace "cryostat-operator-scorecard".
at io.fabric8.kubernetes.client.dsl.internal.OperationSupport.requestFailure(OperationSupport.java:671)
at io.fabric8.kubernetes.client.dsl.internal.OperationSupport.requestFailure(OperationSupport.java:651)
at io.fabric8.kubernetes.client.dsl.internal.OperationSupport.assertResponseCode(OperationSupport.java:597)
at io.fabric8.kubernetes.client.dsl.internal.OperationSupport.lambda$handleResponse$0(OperationSupport.java:560)
at java.base/java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:646)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at io.fabric8.kubernetes.client.http.StandardHttpClient.lambda$completeOrCancel$10(StandardHttpClient.java:140)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at io.fabric8.kubernetes.client.http.ByteArrayBodyHandler.onBodyDone(ByteArrayBodyHandler.java:52)
at java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
at java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
at java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
at java.base/java.util.concurrent.CompletableFuture.complete(CompletableFuture.java:2147)
at io.fabric8.kubernetes.client.okhttp.OkHttpClientImpl$OkHttpAsyncBody.doConsume(OkHttpClientImpl.java:137)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
... 1 more
2024-05-09 19:49:32,145 INFO [io.cry.dis.KubeApiDiscovery] (main) Shutting down KubernetesApi client
2024-05-09 19:49:32,149 INFO [io.cry.dis.KubeApiDiscovery] (main) Closed Endpoints SharedInformer for namespace "cryostat-operator-scorecard"
2024-05-09 19:49:32,177 INFO [io.quarkus] (main) cryostat3 stopped in 0.271s
INFO[0000] subscription "cryostat-operator-v3-0-0-dev-sub" deleted
INFO[0000] customresourcedefinition "cryostats.operator.cryostat.io" deleted
INFO[0001] clusterserviceversion "cryostat-operator.v3.0.0-dev" deleted
INFO[0001] catalogsource "cryostat-operator-catalog" deleted
INFO[0001] operatorgroup "operator-sdk-og" deleted
INFO[0001] Operator "cryostat-operator" uninstalled
serviceaccount "cryostat-scorecard" deleted
role.rbac.authorization.k8s.io "cryostat-scorecard" deleted
clusterrole.rbac.authorization.k8s.io "cryostat-scorecard" deleted
rolebinding.rbac.authorization.k8s.io "cryostat-scorecard" deleted
clusterrolebinding.rbac.authorization.k8s.io "cryostat-scorecard" deleted
Error from server (NotFound): secrets "registry-key" not found
namespace "cryostat-operator-scorecard" deleted
