extentreports-cucumber7-adapter icon indicating copy to clipboard operation
extentreports-cucumber7-adapter copied to clipboard

Does this report support parallel execution on selenium grid for cucumber framework where scenario outline is having multiple example data sets?

Open vamshikrishnapallerla opened this issue 1 year ago • 7 comments

We are using cucumber framework for my project and running my test cases on selenium grid, but when I look at the report i.e pdf and spart extent reports, test scenarios from one feature file is getting mapped to another feature files when there are multiple example data sets for test cases.

Feature 1: @Login Feature: Bing feature file

@TC_01 @test Scenario Outline: Test on Bing Given User navigate to Bing.com When Enter search keyword on Bing

Examples:
  | dataIteration |
  | data01         | 

Feature 2: @Login Feature: Google Feature file

@TC_02 @test Scenario Outline: Test on Google Given User navigate to Google.com When Enter search keyword on Google

Examples:
  | dataIteration |
  | data01        |
  | data02         |
  | data03         |
  | data04        |
  | data05         |
  | data06         |
  | data07        |

I am running these test cases in parallel with below setting on selenium grid having 2 nodes available. @Override @DataProvider (parallel = true) public Object[][] scenarios(){ return super.scenarios(); }

Below is image of our selenium grid: image

Below is the pdf report generated TestExecutionReport.pdf

Below is the screenshot if spart extent report issue Not able to attach html report here. image Ideally it should be present under google feature file

in the summary or failed scenarios section of pdf you can see under bing feature file one of google test is mapped.

is it a known issue? this is a critical issue we had, can you help us on this.

dependencies used in the project are: <groupId>com.aventstack</groupId> <artifactId>extentreports</artifactId> 5.0.9 <groupId>tech.grasshopper</groupId> <artifactId>extentreports-cucumber7-adapter</artifactId> 1.14.0

vamshikrishnapallerla avatar Mar 01 '24 11:03 vamshikrishnapallerla

@grasshopper7 @arun-k @grass-hopper-moc can you check and update on this issue?

vamshikrishnapallerla avatar Mar 04 '24 05:03 vamshikrishnapallerla

Do you have the same behavior when you execute this in your local environment, without grid setup?

grasshopper7 avatar Mar 05 '24 06:03 grasshopper7

@grasshopper7 When running in local environment(sequential execution) reports are generated as expected(accurate).

When running on grid, if none of my test cases has example sets then also I am getting the correct reports.

Issue is with running scripts on grid with 2+ nodes and having test cases with multiple example sets. cc: @arun-k @grass-hopper-moc

vamshikrishnapallerla avatar Mar 05 '24 07:03 vamshikrishnapallerla

Can you try this in parallel mode in local environment?

grasshopper7 avatar Mar 05 '24 07:03 grasshopper7

I will try this and post the updates here either today or tomorrow.

vamshikrishnapallerla avatar Mar 06 '24 07:03 vamshikrishnapallerla

Hi @grasshopper7 I have tested the above and below are the findings.

When I am using dependency version 1.14.0 we are having the issue in the local environment also.

When I downgraded the version from 1.14.0 to 1.9.2 the reports are coming as expected, is there any major change in relation to parallel execution between these two versions?

  • Overall we are having issue in version 1.14.0
  • But reports are generated as expected when I downgraded version to 1.9.2 cc: @arun-k @grass-hopper-moc

vamshikrishnapallerla avatar Mar 07 '24 12:03 vamshikrishnapallerla

@grasshopper7 @grass-hopper-moc This is still an issue with v1.14.0. Is there a fix for this issue?

Soumendu-Khilar avatar Feb 04 '25 19:02 Soumendu-Khilar