compliance-operator
compliance-operator copied to clipboard
The `TestCheckDefaultKubeletConfig` end-to-end test fails on OpenShift 4.12
We've noticed failures in CI after upgrading to 4.12 clusters for testing, see https://github.com/openshift/release/pull/33214:
TestE2E/Parallel_tests/TestCheckDefaultKubeletConfig
helpers.go:298: expecting COMPLIANT got NOT-APPLICABLE
Test output:
--- FAIL: TestE2E/Parallel_tests (0.00s)
--- PASS: TestE2E/Parallel_tests/TestGenericRemediationFailsWithUnkownType (5.12s)
--- PASS: TestE2E/Parallel_tests/TestSuiteWithInvalidScheduleShowsError (10.23s)
--- PASS: TestE2E/Parallel_tests/TestApplyGenericRemediation (15.20s)
--- PASS: TestE2E/Parallel_tests/TestPatchGenericRemediation (15.34s)
--- PASS: TestE2E/Parallel_tests/TestScanWithEmptyTailoringCMNameFails (30.16s)
--- PASS: TestE2E/Parallel_tests/TestScanWithInvalidScanTypeFails (30.19s)
--- PASS: TestE2E/Parallel_tests/TestScanWithInvalidContentFails (55.20s)
--- PASS: TestE2E/Parallel_tests/TestScanWithNodeSelectorNoMatches (25.16s)
--- PASS: TestE2E/Parallel_tests/TestMalformedTailoredScanFails (75.36s)
--- PASS: TestE2E/Parallel_tests/TestScanWithInvalidProfileFails (80.31s)
--- PASS: TestE2E/Parallel_tests/TestScanStorageOutOfLimitRangeFails (10.50s)
--- PASS: TestE2E/Parallel_tests/TestScanSettingBindingWatchesTailoredProfile (15.39s)
--- PASS: TestE2E/Parallel_tests/TestManualRulesTailoredProfile (120.63s)
--- PASS: TestE2E/Parallel_tests/TestSingleTailoredPlatformScanSucceeds (75.22s)
--- PASS: TestE2E/Parallel_tests/TestScheduledSuiteInvalidPriorityClass (135.28s)
--- PASS: TestE2E/Parallel_tests/TestRulesAreClassifiedAppropriately (0.24s)
--- PASS: TestE2E/Parallel_tests/TestScanWithUnexistentResourceFails (55.27s)
--- FAIL: TestE2E/Parallel_tests/TestCheckDefaultKubeletConfig (125.40s)
--- PASS: TestE2E/Parallel_tests/TestProfileModification (137.91s)
--- PASS: TestE2E/Parallel_tests/TestScheduledSuitePriorityClass (145.34s)
--- PASS: TestE2E/Parallel_tests/TestScanWithMissingTailoringCMFailsAndRecovers (145.48s)
--- PASS: TestE2E/Parallel_tests/TestInvalidBundleWithNoTag (5.12s)
--- PASS: TestE2E/Parallel_tests/TestSingleScanWithStorageSucceeds (135.27s)
--- PASS: TestE2E/Parallel_tests/TestScheduledSuiteUpdate (150.58s)
--- PASS: TestE2E/Parallel_tests/TestInvalidBundleWithUnexistentRef (15.11s)
--- PASS: TestE2E/Parallel_tests/TestScanWithNodeSelectorFiltersCorrectly (110.56s)
--- PASS: TestE2E/Parallel_tests/TestMissingPodInRunningState (165.41s)
--- PASS: TestE2E/Parallel_tests/TestSingleTailoredScanSucceeds (110.24s)
--- PASS: TestE2E/Parallel_tests/TestSuiteWithContentThatDoesNotMatch (175.25s)
--- PASS: TestE2E/Parallel_tests/TestScanSettingBinding (105.71s)
--- PASS: TestE2E/Parallel_tests/TestParsingErrorRestartsParserInitContainer (95.46s)
--- PASS: TestE2E/Parallel_tests/TestScanProducesRemediations (90.44s)
--- PASS: TestE2E/Parallel_tests/TestSingleScanSucceeds (100.48s)
--- PASS: TestE2E/Parallel_tests/TestProfileISTagUpdate (141.24s)
--- PASS: TestE2E/Parallel_tests/TestProfileISTagOtherNs (146.09s)
--- PASS: TestE2E/Parallel_tests/TestScheduledSuite (435.66s)
--- PASS: TestE2E/Serial_tests (2438.69s)
--- PASS: TestE2E/Serial_tests/TestScanStorageOutOfQuotaRangeFails (5.27s)
--- PASS: TestE2E/Serial_tests/TestSuiteScan (126.45s)
--- PASS: TestE2E/Serial_tests/TestTolerations (80.58s)
--- PASS: TestE2E/Serial_tests/TestAutoRemediate (441.90s)
--- PASS: TestE2E/Serial_tests/TestUnapplyRemediation (422.08s)
--- PASS: TestE2E/Serial_tests/TestInconsistentResult (75.81s)
--- PASS: TestE2E/Serial_tests/TestPlatformAndNodeSuiteScan (196.29s)
--- PASS: TestE2E/Serial_tests/TestUpdateRemediation (437.41s)
--- PASS: TestE2E/Serial_tests/TestProfileBundleDefaultIsKept (165.53s)
--- PASS: TestE2E/Serial_tests/TestVariableTemplate (140.93s)
--- PASS: TestE2E/Serial_tests/TestKubeletConfigRemediation (346.45s)
FAIL
FAIL github.com/ComplianceAsCode/compliance-operator/tests/e2e 3194.980s
FAIL
make: *** [Makefile:563: e2e] Error 1
We can also recreate this locally by building the operator, deploying it into a 4.12 cluster, and running the e2e tests. At the moment, our CI is broken until we fix this issue.
I reproduced using:
$ export IMAGE_REPO=quay.io/lbragsta/
$ export TAG=`uuidgen`
$ make image && make push
$ make e2e