test-reporter icon indicating copy to clipboard operation
test-reporter copied to clipboard

Test reports being attached to wrong workflow

Open pshirshov opened this issue 2 years ago • 5 comments

I have a repo with two workflows.

This workflow invoked the test reporter: https://github.com/zio/izumi-reflect/actions/runs/3857696050

Though the artifacts were attached to irrelevant workflow: https://github.com/zio/izumi-reflect/actions/runs/3857696046

Please fix.

pshirshov avatar Jan 06 '23 19:01 pshirshov

I have also noticed this. I have multiple workflows using test-reporter, and they all get attached to the same single workflow.

timcassell avatar Jan 06 '23 19:01 timcassell

https://github.com/dorny/test-reporter#github-limitations

Check Runs are created for specific commit SHA. It's not possible to specify under which workflow test report should belong if more workflows are running for the same SHA. Thanks to this GitHub "feature" it's possible your test report will appear in an unexpected place in GitHub UI. For more information, see https://github.com/dorny/test-reporter/issues/67.

flobernd avatar Jan 07 '23 12:01 flobernd

Eh, shite. I guess we should create an issue in gh tracker and mass-vote it.

pshirshov avatar Jan 07 '23 12:01 pshirshov

Eh, shite. I guess we should create an issue in gh tracker and mass-vote it.

@pshirshov Have you already created an issue for the gh tracker? 😀

JWilh avatar Feb 17 '23 12:02 JWilh

This is still an issue... We invoked this behaviour in the following steps:

  • Run A (ok)
  • Run B (ok)
  • Run C (got cancelled)
  • Rub D (ok) --> test report is uploaded to Run B ??

BenjaminYde avatar Sep 20 '23 14:09 BenjaminYde