asyncapi
flaky tests randomly failing in workflow
Some tests (build-newsroom-videos, build-meeting, index, and a few others) pass consistently when run locally but fail randomly in the workflow. These failures occur without any related code changes, indicating flaky behavior.
- Investigate the root cause and identify why these tests are flaky in the workflow but stable locally
- Fix the tests or setup to ensure consistent CI passes
Hey @vishvamsinh28 I would like to work on this issue. Can you please assign it to me?
Take a look on this @vishvamsinh28 ->Use unique temporary directories in tests (e.g. fs.mkdtemp) to avoid conflicts -> Guard the top-level start() call in scripts/index.ts so it only runs when executed directly ->Use os.tmpdir() instead of __dirname in build-meetings.test.ts for temp files we can add this . to fix this
maybe we have already tried this in past but i dont remember exactly, you can give it try if you want to
@patilpratik1905 PRs will priority as he commented first
@vishvamsinh28, just a small suggestion from my side: please refrain from giving a heads-up to more than one person (@patilpratik1905 and @Sourya07) for the same issue at the same time. This helps avoid confusion and duplicate work. giving heads-up to more than one person doesn’t make sense. In the end, this is not a race about whose PR gets merged first.
In this case, since @patilpratik1905 asked for it first, ideally Pratik should go ahead, as he also mentioned that he is working on it.
The interesting part is, we have something more 😄 — I had opened this issue earlier #4671, and it is also a work in progress.
No worries at all 👍 I just took a chance to point out the issue so it gets visibility. I’m not actively working on it right now, so there’s no problem from my side.