Vincent Massol
Vincent Massol
@oscarlvp You can run it with ` mvn clean install -Pquality -Dxwiki.pitest.skip=false -Djacoco.skip=true -U` (the `-U` is to force getting the latest snapshot versions since we rolledback some dependencies that...
Note that for `xwiki-commons-extension-repository-xwiki`, you need to remove the following from the POM (that's my workaround FTM): ``` org.pitest pitest-maven pitest-check mutationCoverage org.xwiki.**.SystemHTTPProxyTest ```
Ok I've found the issue. It's a regression in pitest-junit5-plugin in v0.11. It works fine with v0.10. And still fails in 0.12.
One guess is that timeouts are in play here and when there's a timeout, it's counted as a bad score. We could increase the timeout I guess but that'll also...
FTR here's what we did with the timeoutFactor: https://github.com/xwiki/xwiki-commons/commit/10dd48f8ca7e7bf024216d9d876abb0e6fb71950
Recent case of timeout: https://github.com/xwiki/xwiki-platform/pull/946/files
You can get the last build's workspace from https://ci.xwiki.org/job/xwiki-platform_pitest/ws/xwiki-platform-core/xwiki-platform-webjars/xwiki-platform-webjars-api/target/pit-reports/
Note that today (2020-02-12) we had an unstability again with no code change AFAICS: ``` [ERROR] Failed to execute goal org.pitest:pitest-maven:1.4.10:mutationCoverage (pitest-check) on project xwiki-commons-extension-repository-maven: Mutation score of 85 is...
And another one found today: `[ERROR] Failed to execute goal org.pitest:pitest-maven:1.4.10:mutationCoverage (pitest-check) on project xwiki-platform-mailsender: Mutation score of 26 is below threshold of 44 -> [Help 1]`` I tried it...
Another one: `[ERROR] Failed to execute goal org.pitest:pitest-maven:1.4.10:mutationCoverage (pitest-check) on project xwiki-platform-vfs-api: Mutation score of 62 is below threshold of 67 -> [Help 1]`