bloop icon indicating copy to clipboard operation
bloop copied to clipboard

Tracking flaky tests

Open ckipp01 opened this issue 3 years ago • 1 comments

Related to the https://github.com/scalacenter/bloop/issues/1680 epic I wanted to create an issue to start actually tracking some of the tests that I'm continually seeing failing. As I notice them I'll start listing them in here and then will try to address them one the build has been cleaned up fully.

  • bloop.scalajs.ScalaJsToolchainSpec seems to be failing often in the platform bridges
  • bloop.dap.DebugServerSpec seems to be failing pretty often.
  • bloop.launcher.LatestMainLauncherSpec also seems to be failing often. The weird thing is that it seems to be failing on the check if python is there. There is a timeout of 2 second, so maybe we try to bump that up, but that seems odd to be failing.
  • bloop.dap.DebugProtocolSpec

referring to the python check up above https://github.com/scalacenter/bloop/blob/5406395c9f1fc4f34c3051e51b8dcff95a51c852/bloopgun/src/main/scala/bloop/bloopgun/core/Shell.scala#L214-L218

ckipp01 avatar Dec 15 '22 10:12 ckipp01

I think the problem with the tests is that they assume strict timings, so it's easy for the to be flaky :thinking:

I've been trying to fix them, but I haven't been able to make too much of a dent here.

tgodzik avatar Dec 15 '22 10:12 tgodzik