testng
testng copied to clipboard
testng-team
[Feature] It would be nice to have a number of ignored tests
I thought it would be good to have some number in the report telling how many tests is ignored.
Actual behavior
Now TestNG has in the output report something like:
<testng-results skipped="1" failed="2" total="6" passed="3">
Desired behavior
I thought that some parameter like "ignored" would be useful (similarly as JUnit has).
<testng-results skipped="1" failed="2" total="6" passed="3" ignored="...">
Then, issue #1211 would be probably easily fixable.
What do you think? Regards
Hi @juherr, Thanks for your attention. IMHO although fixing the bug #1211 would be nice and could give an end user some info about number of ignored tests inside JUnit's reports - this issue is a bit different. Because it says about the same feature for a TestNG report.
Don't you consider this a handy feature? Or is it too hard to get it done? Or do you think that such functionality, just inside JUnit reports would be sufficient?
I would be glad to hear your opinion.
Ok. After reading it again, I don't understand what is the difference between a skipped test and an ignored one.
For me, "ignored tests" (aka. disabled) are all tests which have been marked with @Test(enabled = false) in advance.
"Skipped tests" are all tests which TestNG skips during runtime e.g. because they were dependent on not successfully finished methods or groups.
Why am I asking? I always find it useful to know how many tests is currently permanently disabled.
I would like to say +1 for this issue.
We have about 26k tests.
The tests were skipped or ignored? It is important to know because it is hard to find out the reason about 120 tests that were skipped. Having this, we can "don't worry about ignored" and focus on the skipped tests.
A skipped test, it is a test when @Before** failed. So we need to look into each one test that were skipped.
I would like to say that I am available to help to test this issue before the release.
Cheers
@diegolovison I'm not sure to follow you. You talk about skipped tests (where a new feature is already available in the current snapshot version) but this request is about ignored tests (not run).