allure-java icon indicating copy to clipboard operation
allure-java copied to clipboard

Allure report doesn't show all the test methods if I have combination of test methods from the same test class but clubbed under multiple tesNG test

Open motivatedmind opened this issue 3 years ago • 0 comments

Describe the bug

Allure report doesn't show all the test methods if I have combination of test methods from the same test class but clubbed under multiple tesNG test ==> You can see in the screenshot that method <include name="performCalculationsSoap" description="Perform calculations - 1"> is not displayed

To Reproduce Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior Allure report should show same test methods as declared in testng xml

Screenshots

image

Desktop (please complete the following information):

  • OS: [e.g. iOS] Win 10
  • Browser [e.g. chrome, safari] Chrome
  • Version [e.g. 22] 90.x

Smartphone (please complete the following information):

  • Device: [e.g. iPhone6]
  • OS: [e.g. iOS8.1]
  • Browser [e.g. stock browser, safari]
  • Version [e.g. 22]

Additional context I am generating testNG.xml programmatically from xml sheet and executing via maven failsafe plugin

TestNG xml ==>

<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE suite SYSTEM "http://testng.org/testng-1.0.dtd">
<suite thread-count="1" verbose="0" name="My Test Suite">
  <test name="My Test - 1">
    <parameter name="browser" value="CHROME"/>
    <classes>
      <class name="com.example.tests.CalculatorSoapApiTest">
        <methods>
          <include name="performCalculationsSoap" description="Perform calculations - 1">
            <parameter name="tcId" value="TC5"/>
          </include>
          <include name="retrieveByIdRest" description="Retrieve - 1">
            <parameter name="tcId" value="TC5"/>
          </include>
        </methods>
      </class>
    </classes>
  </test>
  <test name="My test -2" >
    <parameter name="browser" value="CHROME"/>
    <classes>
      <class name="com.example.tests.CalculatorSoapApiTest">
        <methods>
          <include name="performCalculationsSoap" description="Retrieve - 2">
            <parameter name="tcId" value="TC7"/>
          </include>
        </methods>
      </class>
    </classes>
  </test>
</suite>

motivatedmind avatar May 06 '21 12:05 motivatedmind