reporter icon indicating copy to clipboard operation
reporter copied to clipboard

Shared run sometimes is not triggered

Open soliarudyk opened this issue 2 years ago • 5 comments

Describe the bug When TESTOMATIO_SHARED_RUN=1 parameter is set I expect to receive 1 test run when I have a few workers running tests in parallel, instead a few runs are created

To Reproduce Set up in package.json 2 scripts first one is abasic script for running tests, the second one is more parameterized version of the first one like this: "test:parallel": "TESTOMATIO=${TESTOMATIO_TOKEN} TESTOMATIO_URL=${TESTOMATIO_URL} TESTOMATIO_CREATE=1 cross-env HEADLESS=true codeceptjs run-workers 10 --plugins allure", "test:checkout": "TESTOMATIO_TITLE="E2E-checkout build:${BUILD_ID}" TESTOMATIO_SHARED_RUN=1 TEST_SUITE=checkout npm run test:parallel -- --grep '(?=.*@Checkout)'",

And trigger secondscript: npm run test:checkout

Expected behavior One test run should be generated

NOTE: sometimes a few test runs are created in case if env variable BUILD_ID was not passed and then test run title becomes E2E-checkout build: and we see a few runs like this in the testomat system

Screenshots Screenshot 2023-11-14 at 12 44 53

Desktop (please complete the following information):

  • OS: Mac
  • Browser chrome
  • Version 19.0.6045.105

soliarudyk avatar Nov 14 '23 11:11 soliarudyk

@DavertMik multiple runs are created when run multiple workers to simplify the reproduction steps, run something like TESTOMATIO_SHARED_RUN=1 TESTOMATIO_TITLE='E2E-tests' npx codeceptjs run-workers 2

olexandr13 avatar Jan 19 '24 15:01 olexandr13

@DavertMik does TESTOMATIO_SHARED_RUN could be used only with start-test-run command?

olexandr13 avatar Feb 15 '24 18:02 olexandr13

please investigate

olexandr13 avatar Oct 14 '24 12:10 olexandr13

@AZANIR please re-test

DavertMik avatar Oct 25 '24 10:10 DavertMik