agent-java-testNG icon indicating copy to clipboard operation
agent-java-testNG copied to clipboard

Test logs are empty + missed suites

Open olegberegeyko-fth opened this issue 2 months ago • 1 comments

Versions: agent-java-testng 5.6.2 logger-java-log4j 5.4.0 client-java 5.4.3 reportportal - 5.14.4

Steps to Reproduce

  1. exists list of xml suites. each of them has e.g. suite1.xml
<suite name="Suite 1">
    <listeners>
        <listener class-name="com.softswiss.pg.base.listeners.ReportPortalListener"/>
    </listeners>

<test name="Create tests">
        <classes>
            <class name="com.project.regression.analytic.collect_data.CreateTest"/>
        </classes>
    </test>
    <test name="Update test">
        <classes>
            <class name="com.project.regression.analytic.collect_data.UpdateTest"/>
        </classes>
    </test>
    <test name="Get test">
        <classes>
            <class name="com.project.regression.analytic.collect_data.GetTest"/>
        </classes>
    </test>

  1. exists all.xml suite that collect other xml suites as import
<suite name="Regression suite">
<listeners>
        <listener class-name="com.softswiss.pg.base.listeners.ReportPortalListener"/>
    </listeners>

    <suite-files>
        <suite-file path="analytic/suite1.xml"/>
        <suite-file path="analytic/suite2.xml"/>
        <suite-file path="analytic/suite3.xml"/>
        <suite-file path="analytic/suite4.xml"/>
      <suite-files>
  1. run all.xml suite

Expected behavior All suites and tests appears in reportportal. Logs displayed

Actual behavior Some test from included in all.xml suites missed. I see during execution that suite started on RP, but counter total tests not changed. After a few time tests from suite starts displayed, but without some classed. For provided example I see following structure: Regression suite-> Suite 1-> Update test

"Create test" missed in launch! Also all logs are empty and displayed as "No results found"

Additional context I downgraded dependencies to following: agent-java-testng 5.4.2 logger-java-log4j 5.2.2 client-java 5.2.14 and it fixed - no any missed suite/class, all logs displayed as expected

olegberegeyko-fth avatar Oct 08 '25 21:10 olegberegeyko-fth

@olegberegeyko-fth Unfortunately, it's impossible to say what's wrong by your description, we have our own example project which works pretty fine: https://github.com/reportportal/examples-java/tree/master/example-testng-log4j

Could you please craft an example project which reproduces the issue and report it on our demo instance (https://demo.reportportal.io)?

HardNorth avatar Oct 09 '25 10:10 HardNorth

Abandoned

HardNorth avatar Nov 13 '25 11:11 HardNorth