xcpretty icon indicating copy to clipboard operation
xcpretty copied to clipboard

Test results no longer contain test failures

Open ButkiewiczP opened this issue 7 years ago • 7 comments

So there seems to be some confusion around whether this was actually fixed, or is in the process of being fixed.

As of the 0.2.4 release, test failures are no longer included in the output (only verified on Xcode 8 right now). This was originally captured in issue #209 / #234 and later addressed in PR #240. However, before 0.2.4 was released, the changes from that PR were reverted in commit 28a56ab .

Is there something else that needs to be fixed in order to get that change merged again? I'm not sure why it was reverted, as this has been an issue for quite a few months now.

ButkiewiczP avatar Jul 05 '17 06:07 ButkiewiczP

+1

rfodge avatar Jul 07 '17 18:07 rfodge

This is still a issue 👎

jetersen avatar Oct 26 '17 07:10 jetersen

See also issue #291, which manage "testing restarts" xcode does when a test crashes (swift fatalError for example)

kenji21 avatar Oct 26 '17 08:10 kenji21

Also seeing this

daniel-beard avatar Dec 08 '17 17:12 daniel-beard

I still face the issue. If some thread-safe code test fail, it mostlly will call Objective-C realse and finally call CFRelease -> pthread_kill, which trigger a SIGABRT signal and no any error reason occur. I have to check the raw stdout to find this reason, really suck. Any good idea ?

dreampiggy avatar Feb 20 '18 06:02 dreampiggy

Any activity planned for this issue?

Isn't it actually a key feature of Xcpretty containing all executed tests (including crashed once) in the XML?

stidch avatar Apr 17 '21 15:04 stidch

We're seeing this issue as well, where crashed tests don't appear in the xcpretty JUnit output. Related: https://github.com/xcpretty/xcpretty/issues/291

Assertion failures are fine, but crashed tests are missing.

draganrakas avatar Nov 23 '21 16:11 draganrakas