[BUG] `versioned_tag` test crashes when running workload and exits the test run

[HashNuke]

Describe the bug versioned_tag test crashes. This prevents further tests from being run when running workload.

To Reproduce Steps to reproduce the behavior:

1. On, RHEL 8, install kind, create a cluster and install a CNF (sample_coredns)
2. Run ./cnf-testsuite workload or ./cnf-testsuite versioned_tag

The testsuite will crash with the following trace:

Expected behavior The versioned_tag test should output a pass or fail result instead of crashing.

Environment info

• RHEL 8
• Kubernetes server v1.25.0
• Kubernetes client v1.25.2

[HashNuke]

versioned_tag is not a cert test. But has to be fixed since it blocks running any further workload tests after it crashes.

[lixuna]

@HashNuke and @agentpoyo what is the status of this issue? Was it included in v0.35.0?

[lixuna]

@HashNuke and @agentpoyo can this issue be closed?

[agentpoyo]

I believe it can be, we can verify.

[HashNuke]

The error in my screenshot in the ticket description mentions PodSecurityPolicy with version policy/v1beta1. This resource has been deprecated and removed - https://kubernetes.io/docs/concepts/security/pod-security-policy/

I just checked the repository for this resource & version being used. https://github.com/search?q=repo%3Acnti-testcatalog%2Ftestsuite%20podsecuritypolicy&type=code

Looks like we have certain CNFs using this resource & version.

This issue is still relevant. The CNFs need to be updated to follow recommendations on the k8s documentation page linked above.

Sidenote: This error on RHEL very likely occurred due to the kind version and the k8s version being used are much higher than what we test with on Github Actions.

[kosstennbl]

Seems to be still valid. It seems, that there are 2 issues in this one:

1. opa_setup.cr doesn't have needed safeguards and exception captures.
2. policy/v1beta1 is used in definition of some CNFs in testsuite samples.

Both of these issues seem to be still relevant.