Flaky tests umbrella ☂️

[danez]

Our tests are failing from time to time with different errors. These errors are unrelated to the actual changes in PRs.

As a first step, I thought it would be a good idea to collect these errors.

• Add errors as separate comments.
• Add logs where this happened to the comment. (I guess maximum 5 or so)

[danez]

Error: listen EADDRINUSE: address already in use :::<PORT>

~~Windows & Mac When this happens it happens a couple of times in a row.~~

~~https://github.com/netlify/cli/runs/6597781685?check_suite_focus=true https://github.com/netlify/cli/runs/6597696852?check_suite_focus=true~~

Done

[danez]

wasm streaming compile failed: TypeError: Failed to parse URL from /Users/runner/work/cli/cli/node_modules/netlify-redirector/lib/redirects.wasm␊ falling back to ArrayBuffer instantiation␊ › HTTPError: Response code 503 (Service Unavailable)`,

~~https://github.com/netlify/cli/runs/6597695768?check_suite_focus=true~~

~~In progress: Updating netlify-redirector.~~

[danez]

~~yarn → should install the cli and run the help command~~ ~~✖ Timed out while running tests~~ ~~https://github.com/netlify/cli/runs/6598249957?check_suite_focus=true~~

~~#4637~~

Done

[danez]

EBUSY: resource busy or locked, rmdir ...

Windows

https://github.com/netlify/cli/runs/6612669436?check_suite_focus=true

[danez]

Error: EPERM: operation not permitted, rename 'C:\Users\runneradmin\AppData\Roaming\netlify\Config\config.json.3515056301' -> 'C:\Users\runneradmin\AppData\Roaming\netlify\Config\config.json'`,

Windows

https://github.com/netlify/cli/runs/6612669436?check_suite_focus=true

[JWhist]

Eleventy test frequently fails with connection refused error

[danez]

Closing, it is a lot better now, and we should handle the ones that come up.