PAT does not distinguish between successful and failed iterations when reporting statistics

[anEXPer]

When using PAT, we saw a discrepancy between reported averages and actual useful average information.

Here's a processed presentation of a couple of interesting test runs that highlight this situation: http://perf-test-graphs.cfapps.io/13.html

This graph displays the results of a test run that included a great number of very brief errors - ~0.2 seconds. It also has three failures from timeouts, which are more than twice as long as most of the results.

I don't want either sort of error mixed with my successful iterations when looking at the results.

There's a statistical summary at the bottom of the chart. The difference between the mean listed in the statistical summaries of all iterations vs successful iterations only is significant - 55.8 seconds vs. 108.98 seconds.

The fact that PAT only displays the former during a run makes it difficult to determine what's going on. Ideally, PAT would report a successes-only and perhaps failures-only number in addition to the combined number.