Maven smoke tests are flaky

[PerfectSlayer]

Test suite

test test_failed_maven_run_flaky_retries, v3.9.6 from datadog.smoketest.MavenSmokeTest. Marked flaky by CircleCI

Error

Condition not satisfied after 15.00 seconds and 37 attempts
	at spock.util.concurrent.PollingConditions.within(PollingConditions.java:185)
	at spock.util.concurrent.PollingConditions.eventually(PollingConditions.java:140)
	at datadog.trace.civisibility.CiVisibilitySmokeTest.waitForCoverages(CiVisibilitySmokeTest.groovy:236)
	at datadog.trace.civisibility.CiVisibilitySmokeTest.verifyEventsAndCoverages(CiVisibilitySmokeTest.groovy:177)
	at datadog.smoketest.MavenSmokeTest.test #projectName, v#mavenVersion(MavenSmokeTest.groovy:61)
Caused by: Condition not satisfied:

receivedCoverages.size() == traceSize
|                 |      |  |
|                 2      |  1
|                        false
[[version:2, coverages:[[test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:947516651552068468, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]], [test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:5155894487225088796, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]], [test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:5393341085870037505, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]], [test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:9039952828890324306, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]]]], [version:2, coverages:[[test_session_id:2415258914049928723, test_suite_id:127719938380221125, span_id:4945266185610920573, files:[[filename:src/main/java/datadog/smoke/Calculator.java, segments:[[5, -1, 5, -1, -1]]], [filename:src/test/java/datadog/smoke/TestFailed.java, segments:[[7, -1, 7, -1, -1], [11, -1, 11, -1, -1]]]]]]]]

	at datadog.trace.civisibility.CiVisibilitySmokeTest.waitForCoverages_closure2(CiVisibilitySmokeTest.groovy:237)
	at datadog.trace.civisibility.CiVisibilitySmokeTest.waitForCoverages_closure2(CiVisibilitySmokeTest.groovy)
	at groovy.lang.Closure.call(Closure.java:412)
	at spock.util.concurrent.PollingConditions.within(PollingConditions.java:168)
	... 4 more

Cause

Only one of the two coverages is received.

Environment

Any version of Java and JVM.

Logs

test.zip