allure-java icon indicating copy to clipboard operation
allure-java copied to clipboard

Report shows wrong "pending" tests when running only particular severity

Open Mittjaywal opened this issue 6 years ago • 2 comments

I'm submitting a ... [ x] Feature Requsest

What is the current behavior?

When I'm passing the severity parameter from jenkin, it should execute only those test cases with matching jenkin severity. For this I have implemented IAnnotationTransformer and I'm disabling the test case which are not matching with jenkin severity paramter using annotation.setEnabled(false).

But when I see the Allure report, All unmatched test cases are coming as pending. if (!JENKIN_SEVERITY.equalsIgnoreCase(String.valueOf(testInfo.severity()))) { annotation.setEnabled(false); } Please check this screenshot where only one test case matching with blocker but others coming as pending Screen Shot 2019-09-05 at 10 15 09 AM

What is the expected behavior? Should display only test cases which are enabled as true

What is the motivation / use case for changing the behavior? Allure report for running test cases which are matching jenkin severity paramter

Which environment <groupId>ru.yandex.qatools.allure</groupId> <artifactId>allure-maven-plugin</artifactId> 2.5 <reportDirectory>allure-report</reportDirectory> Hint: In AllureTestListener.addPendingMathods() , it should have filter where it should pick all the tes cases which are marked as enabled = true

Mittjaywal avatar Sep 05 '19 15:09 Mittjaywal

Please help me to get solution for this.

Mittjaywal avatar Sep 09 '19 14:09 Mittjaywal

you are using Allure 1 thats reached EOL. Please upgrade to latest version and open a new issue if problem still exists

baev avatar Dec 09 '19 11:12 baev