acceptance-test-harness icon indicating copy to clipboard operation
acceptance-test-harness copied to clipboard

Published 20 hours ago • verified publisher icon jenkinsci

JobConfigHistoryPluginTest is flaky

Open raul-arabaolaza opened this issue 1 year ago • 1 comments

Jenkins and plugins versions report

Latest version of jenkins weekly as used by the pr builder

What Operating System are you using (both controller, and any agents involved in the problem)?

Whatever is used on ci.jenkins.io

Reproduction steps

JobConfigHistoryPluginTest is flaky, on several runs of #1037 it has been randomly failing or working without clear errors due to changes absolutely unrelated to the test itself. Like fixing the SVN docker container to work with ubuntu instead of centos.

Flaky tests are a pain for two reasons:

  • It decreases the confidence in PR builders failing by default
  • It reduces the possibility of a proper pr be automerged

Expected Results

The test works consistently

Actual Results

It fails randomly

Anything else?

No response

raul-arabaolaza avatar Mar 08 '23 08:03 raul-arabaolaza