statusboard icon indicating copy to clipboard operation
statusboard copied to clipboard

Flaky tests

Open lukekarrys opened this issue 2 years ago • 1 comments

Here's a list of flaky tests I've seen across our supported repos:

  • [ ] npm/cli: get node integration green
  • [ ] @npmcli/arborist: https://github.com/npm/cli/actions/runs/3928786524
  • [x] npm/ignore-walk: https://github.com/npm/ignore-walk/actions/runs/3928775936
  • [x] fs-minipass: https://github.com/npm/fs-minipass/actions/runs/3984841403
  • [ ] minipass-fetch: https://github.com/npm/minipass-fetch/actions/runs/4009475310/jobs/6884876964
  • [ ] make-fetch-happen: https://github.com/npm/make-fetch-happen/actions/runs/3927650948/jobs/6714458250
  • [ ] tap-nock: https://github.com/npm/tap-nock/actions/runs/4126626699/jobs/7128805133
  • [ ] read-package-json: https://github.com/npm/read-package-json/actions/runs/4126624250/jobs/7128799142
  • [ ] metavuln-calculator: https://github.com/npm/metavuln-calculator/actions/runs/4126696910/jobs/7128958897
  • [ ] normalize-package-data: https://github.com/npm/normalize-package-data/actions/runs/4126748375/jobs/7129080000

lukekarrys avatar Jan 18 '23 18:01 lukekarrys

npm/ignore-walk

This one is less flaky now and seems to have been fixed by increasing the test timeout, even though the flaky failures were not explicitly due to tests timing out.

npm/minipass-fetch

Capture action item to fix test here: https://github.com/npm/minipass-fetch/issues/91

npm/make-fetch-happen

Identified the test here: https://github.com/npm/make-fetch-happen/issues/209

npm/fs-minipass

Identified and triaged a probable root cause: https://github.com/npm/fs-minipass/issues/24

lukekarrys avatar Jan 25 '23 20:01 lukekarrys