testsuite icon indicating copy to clipboard operation
testsuite copied to clipboard

Published 20 hours ago • verified publisher icon cnti-testcatalog

[Bug] Spec test for 'rolling_downgrade' runs the test multiple times

Open kosstennbl opened this issue 10 months ago • 1 comments

https://github.com/cnti-testcatalog/testsuite/blob/83f08b67171cfeeac84e0e4d2af60ff521ef1393/spec/workload/configuration_spec.cr#L149-L154

'rolling_downgrade' should pass when valid version is given test has call of cnf_testsuite in a retry block, which could cause multiple calls of the same test. This seems like an incorrect behavior of spec test, maybe retries should be removed?

kosstennbl avatar Apr 03 '24 14:04 kosstennbl

Same issue in compatibility_spec.cr

kosstennbl avatar Apr 08 '24 07:04 kosstennbl