runner icon indicating copy to clipboard operation
runner copied to clipboard

Test runner doesn't print an error trace on CI

Open paambaati opened this issue 9 months ago • 0 comments

Package version

3.1.4

Describe the bug

I have recently migrated a fairly popular project from tap to japa, and while the tests pass locally, they fail on CI in a non-deterministic way (this might not be a bug with japa itself). When the tests fail, the runner doesn't make it clear what failed, nor does it print any trace.

See these test runs –

  1. First run, tests pass on macOS but fail on Windows, but curiously there's no error trace – https://github.com/paambaati/codeclimate-action/actions/runs/9297933903/job/25588922355
  2. Second run, failing test pinned, everything green – https://github.com/paambaati/codeclimate-action/actions/runs/9298044668
  3. Third run, tests fail on Linux, and its not clear which test failed, and it doesn't have an error trace – https://github.com/paambaati/codeclimate-action/actions/runs/9298069930/job/25589289156

Reproduction repo

https://github.com/paambaati/codeclimate-action/pull/747

paambaati avatar May 30 '24 06:05 paambaati