allure-js icon indicating copy to clipboard operation
allure-js copied to clipboard

BROKEN tests failure messages are incomplete with respect to the Playwright HTML report

Open DvDream opened this issue 1 year ago • 5 comments

Describe the bug Details for failures of tests resulted in status BROKEN because of "timeout exceeded" shows only the message

Test timeout of .....ms exceeded.

and I am pretty sure that there are other informations about the reason of the failures because the Playwright HTML report shows me more "message blocks".

Those error in the Playwright reports are show as separate blocks.

To Reproduce Steps to reproduce the behavior:

  1. Execute a test with allure-playwright dependency installed. Mine at the moment is 2.0.0-beta.19
  2. The test fail
  3. I generate both playwright HTML report and allure report. The first says the test is failed, the second says the test is broken. Both for test timeoput exceeded
  4. Viewing the reasons for the error, the playwright html report shows me more message block for the reason of the failure, the allure one shows me only the first, that is Test timeout of .....ms exceeded.

Expected behavior I would like to view the same report failures messages as the playwright HTML reporter in case of broken tests.

Screenshots image image

Desktop (please complete the following information):

  • OS: WIndows 10
  • Browser: Chrome
  • Version 111.0.5563.64

info about my allure settings:

I got the default settings for everything, that is all the steps are shown in the report.

DvDream avatar Mar 14 '23 10:03 DvDream