cypress-allure-plugin icon indicating copy to clipboard operation
cypress-allure-plugin copied to clipboard

The report does not show the total number of tests ran

Open VictorAlmeidaTR opened this issue 1 year ago • 3 comments

Describe the bug The report does not show the total number of tests ran.

For example: In the photos I attached, I ran a total of 485 tests, but in the report it only shows 435 tests

To Reproduce Steps to reproduce the behavior:

  1. Run all tests and compare number ran tests with report

Expected behavior To show all tests in Report, in Version 2.35.2 works. in version 2.40.0 not works

Environment (please complete the following information):

  • Cypress version: 12.14.0
  • OS: Linux

** Developer Tools Console Output **

Additional context Add any other context about the problem here.

VictorAlmeidaTR avatar Jun 16 '23 15:06 VictorAlmeidaTR

checking the git actions log, I found this error, I don't know if it was related

This only happens in this version, several tests simply do not appear in the report, even if they have been executed.

In the git actions repository a value appears and in the report another appears

LOG:

2023-06-15T22:41:21.2543217Z [30148:0615/224121.252897:ERROR:ssl_client_socket_impl.cc(983)] handshake failed; returned -1, SSL error code 1, net_error -101 2023-06-15T22:41:44.1801091Z [32m ✓[0m[90m MUNICIPAL --> BAURU --> OBRIGACOES - Meio Magnetico - VALIDADOR ISS.WEB (cypress/e2e/municipal/bauru/obrigacoes/obrigacoes.spec.ts)[0m[31m (183123ms)[0m 2023-06-15T22:41:46.2571403Z

VictorAlmeidaTR avatar Jun 19 '23 15:06 VictorAlmeidaTR

I have the same problem, several tests are not appearing in the report. I've run them multiple times, and the result keeps changing. With each execution, different tests are not being reported. My solution was to roll back the dependency to 2.35.2. I'm analyzing the log more thoroughly, but I can't find a pattern among the failures. Even in debug mode, the log doesn't give me a more specific exception. The only thing I've noticed is that it takes more than 450 executed tests for the problem to occur

PalmeiraGuilhermeTR avatar Jun 21 '23 16:06 PalmeiraGuilhermeTR

I have encountered the same issue, but seems to be related with @cypress/grep. My project comprises multiple sites, and I rely on tags to execute tests for each specific site. Typically, I use two tags for each site, namely "[all]" and "[theSiteName]". However, the problem I'm facing is that the test report is displaying only the tests with the "[theSiteName]" tag, completely omitting the ones with the site-specific tag "[all]".

PolianaRufatto avatar Aug 03 '23 09:08 PolianaRufatto