caraya icon indicating copy to clipboard operation
caraya copied to clipboard

JUnit Test Report reports failures as skipped tests

Open agluck28 opened this issue 2 years ago • 0 comments

When generating JUnit XML reports, if there is a test failure, not an error, the XML report will state that the step was Skipped but also state the failure message is FAIL.

The issue appears to be in Caraya.lvlib:Test ReportJUnit.lvclass:Test To Report Entry.vi. When iterating through the test cases, the failures are not being passed out of the For Loop. When calculating the tests, skipped tests, errors and failures after the For Loop, errors and failures are being set to the same value and the number of actual failures are not being subtracted from the tests run causing them to be reported as skipped tests. Below image is current implementation on version 1.2.1.131

image

The following changes to the parsing of the results allows for failures to be correctly reported.

fix_junit_report

agluck28 avatar Nov 18 '22 20:11 agluck28