cypress-cloud icon indicating copy to clipboard operation
cypress-cloud copied to clipboard

When running parallel tests, runner has issues finding tests because of commas in the spec name

Open t00 opened this issue 8 months ago • 1 comments

Please confirm

  • [x] I have searched for duplicate or closed issues and discussions.
  • [x] I will include a minimal, self-contained set of instructions for consistently reproducing the issue.
  • [x] I will attach a full debug log, otherwise the issue will be closed with no response.

Environment information

System: OS: Linux 6.14 Arch Linux CPU: (16) x64 AMD Ryzen 7 7840S with Radeon 780M Graphics Memory: 12.77 GB / 27.18 GB Container: Yes Shell: 5.2.37 - /bin/bash Binaries: Node: 22.14.0 - ~/.nvm/versions/node/v22.14.0/bin/node npm: 11.2.0 - ~/.nvm/versions/node/v22.14.0/bin/npm Browsers: Chromium: 135.0.7049.114 npmPackages: @4tw/cypress-drag-drop: ^2.2.5 => 2.3.0 @currents/playwright: ^1.12.3 => 1.12.3 @cypress/angular: 0.0.0-development @cypress/mount-utils: 0.0.0-development @cypress/react: 0.0.0-development @cypress/react18: 0.0.0-development @cypress/svelte: 0.0.0-development @cypress/vue: 0.0.0-development @cypress/vue2: 0.0.0-development @playwright/test: ^1.52.0 => 1.52.0 @types/chai: ^5.0.1 => 5.2.2 @types/jest-image-snapshot: ^6.4.0 => 6.4.0 @types/mocha: ^10.0.9 => 10.0.10 @types/node: ^22.9.0 => 22.15.17 (16.18.126) adm-zip: ^0.5.16 => 0.5.16 cross-env: ^7.0.3 => 7.0.3 cross-var: ^1.1.0 => 1.1.0 cy2: ^4.0.9 => 4.0.9 (3.4.3) cypress: ^12.17.4 => 12.17.4 cypress-cloud: ^1.13.0 => 1.13.0 cypress-file-upload: ^5.0.8 => 5.0.8 cypress-image-snapshot: ^4.0.1 => 4.0.1 cypress-plugin-tab: ^1.0.5 => 1.0.5 cypress-real-events: ^1.13.0 => 1.14.0 cypress-wait-until: ^3.0.2 => 3.0.2 dayjs: ^1.11.13 => 1.11.13 deepmerge: ^4.3.1 => 4.3.1 diff-match-patch-typescript: ^1.1.0 => 1.1.0 dotenv-cli: ^8.0.0 => 8.0.0 mammoth: ^1.8.0 => 1.9.0 mkdirp: ^3.0.1 => 3.0.1 (0.5.6, 1.0.4) node-xlsx: ^0.24.0 => 0.24.0 npm-run-all: ^4.1.5 => 4.1.5 rimraf: ^3.0.2 => 3.0.2 (2.7.1) run-script-os: ^1.1.6 => 1.1.6 shx: ^0.3.4 => 0.3.4 string-algorithms: ^1.0.31 => 1.0.31 tslint: ^6.1.3 => 6.1.3 typescript: ^5.6.3 => 5.8.3 util: ^0.12.5 => 0.12.5 wait-on: ^8.0.1 => 8.0.3 xml-formatter: ^3.6.3 => 3.6.5 npmGlobalPackages: corepack: 0.31.0 dotenv-cli: 8.0.0 npm: 11.2.0

Describe the bug

[31m[94mc:\jenkins\workspace\tests-pipeline\[33mcypress\e2e\Banks\Create Bank,c:\jenkins\workspace\tests-pipeline\ Open,c:\jenkins\workspace\tests-pipeline\ Add Question,c:\jenkins\workspace\tests-pipeline\ Exit 234.cy.ts[94m[31m[39m
 WARNING  Exhausted max retries: 2/2
 WARNING  Cypress runner failed with message: "Could not find Cypress test run results"
 WARNING  The following spec files will be marked as failed: 
 - c:/jenkins/workspace/tests-pipeline/cypress/e2e/Banks/Create Bank
 -  Open
 -  Add Question
 -  Exit 234.cy.ts

spec path:

e2e/Banks/Create Bank, Open, Add Question, Exit 234.cy

The cypress-cloud is ran on Windows with project jd, record key and sorry-cypress URL environment variables.

cypress-cloud --parallel --record --ci-build-id 1234

currents.config.js

module.exports = {
  e2e: {
    batchSize: 1
  },
  retry: {
    hardFailureMaxRetries: 2
  }
};

Expected behavior

Spec "e2e/Banks/Create Bank, Open, Add Question, Exit 234.cy" is ran

Setup and Command

      if (process.env.CURRENTS_PROJECT_ID) {
        await cloudPlugin(on, config);
      }

Full log and debug output

// Put your logs below this line


t00 avatar May 09 '25 06:05 t00

Somewhat related: currents playwright client pwc-p also fails on brackets and even spaces. Possibly other characters. Names work when using playwright test directly when all mentioned "special" characters are escaped with \

This does not work:

npx playwright test "8246/Send-new-help-messages-(filtering).test.ts"

This works:

npx playwright test "8246/Send-new-help-messages-\(filtering\).test.ts"

t00 avatar May 24 '25 13:05 t00