opentera-webrtc icon indicating copy to clipboard operation
opentera-webrtc copied to clipboard

Unreliable tests on macOS that sometimes fail unexplicably

Open philippewarren opened this issue 1 year ago • 1 comments

Describe the bug Some of the tests on macOS are flaky (they sometimes work, and they sometimes fail unexplicably). Frequently caused by sockets (socket.io) connections. Also sometimes it is because of broken pipes (SIGPIPE). Also sometimes, tests just fail. This does not happen in GitHub's CI macOS runners, only on local machines. There might be two different problems: websockets (socket.io) and datagrams (low-level libwebrtc). The socket function fails inside of libwebrtc (here).

To Reproduce Run tests on macOS multiple times.

Expected behavior The tests always succeed.

Desktop (please complete the following information):

  • OS: macOS
  • Browser: N.A.
  • Version: N.A.

Additional context This could be caused by a security feature of macOS 13, maybe. This is worth exploring.

philippewarren avatar May 30 '23 14:05 philippewarren