app icon indicating copy to clipboard operation
app copied to clipboard

Test runs using "@testomatio/reporter" are very slow when running API tests in GitLab

Open qakos opened this issue 1 year ago • 1 comments

Describe the bug In GitLab, test runs using "@testomatio/reporter" are slow when running API tests, including some parameterized tests. With a total of over 3,000 tests, the run takes 2.6 minutes to complete. However, the GitLab job still waits for "@testomatio/reporter" for an additional 20 minutes, causing a significant delay.

To Reproduce Steps to reproduce the behavior:

  1. Run tests with @testomatio/reporter

Expected behavior A clear and concise description of what you expected to happen. Test runs using "@testomatio/reporter" should not be causing a significant delay, such as 20 minutes.

Screenshots If applicable, add screenshots or video to help explain your problem. 28-02-24__01

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Browser Version [e.g. 22]
  • Application: [production or beta]

Additional context Playwright: 1.42.0 @testomatio/reporter: 1.2.1

qakos avatar Feb 28 '24 13:02 qakos

@qakos we think it was temporary issue with out job server if issue persist please reopen it

DavertMik avatar Feb 28 '24 21:02 DavertMik

Should have been fixed with bulk reporting in reporter 1.4.0

DavertMik avatar May 23 '24 20:05 DavertMik

@qakos can we ask you to check this on your CI with the latest reporter version?

TetianaKhomenko avatar Jun 05 '24 07:06 TetianaKhomenko

@qakos please re-open the ticket if the issue still persist

TetianaKhomenko avatar Jun 26 '24 09:06 TetianaKhomenko