playwright icon indicating copy to clipboard operation
playwright copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

[Feature] separate `fixme` and `skip` in html report

Open dimkin-eu opened this issue 2 years ago • 3 comments

Both test groups are shown inside 1 column. but could be nice to see them independent

  176 skipped
  1912 passed (25m)
  Skipped Breakdown: 19 skipped, 157 fixme

image

related to this https://github.com/microsoft/playwright/issues/15239

dimkin-eu avatar Dec 07 '22 14:12 dimkin-eu

agree, would be nice

DmitryLitvinenko avatar Dec 07 '22 14:12 DmitryLitvinenko

yeah, it would be very helpful

viktorija-shilova avatar Dec 07 '22 14:12 viktorija-shilova

Please provide this functionality, It would be super helpful !

max2685 avatar Dec 08 '22 12:12 max2685

Voted for this feature!

yurii-sav avatar Jun 08 '23 12:06 yurii-sav

So, the Annotations docs currently say that:

test.fixme() marks the test as failing. Playwright Test will not run this test, as opposed to the fail annotation. Use fixme when running the test is slow or crashes.

but fixme tests aren't actually tallied in the "Failed" tab of the reporter. 🤨 This is confusing. Please:

  • add a fixme tab/column to the HTML Reporter
  • clarify in the docs that fixme tests aren't actually marked as failing

blordpluto avatar Jul 27 '23 22:07 blordpluto