OCUnit2JUnit icon indicating copy to clipboard operation
OCUnit2JUnit copied to clipboard

Performance tests time taken is wrong

Open dlednik opened this issue 10 years ago • 0 comments

In this case it's a benchmark test.

It should report that it took 0.316s not 3.607 for the whole test

where 0.316 seconds is the average time for 10 passes this is a feature of the new XCTest framework with

measureBlock{ () -> Void in
}

Results output:

Test Case '-[RTiOSSDK_UnitTestsTests.GeometryEnginePerformanceTests testBenchmarkWithinOnSmallPolygon]' started.
<unknown>:0: Test Case '-[RTiOSSDK_UnitTestsTests.GeometryEnginePerformanceTests testBenchmarkWithinOnSmallPolygon]' measured [Time, seconds] average: 0.316, relative standard deviation: 0.759%, values: [0.320914, 0.317904, 0.316536, 0.314073, 0.318229, 0.313852, 0.313627, 0.319198, 0.314853, 0.315057], performanceMetricID:com.apple.XCTPerformanceMetric_WallClockTime, baselineName: "", baselineAverage: , maxPercentRegression: 10.000%, maxPercentRelativeStandardDeviation: 10.000%, maxRegression: 0.100, maxStandardDeviation: 0.100
Test Case '-[RTiOSSDK_UnitTestsTests.GeometryEnginePerformanceTests testBenchmarkWithinOnSmallPolygon]' passed (3.607 seconds).

dlednik avatar Nov 27 '14 14:11 dlednik