nethermind icon indicating copy to clipboard operation
nethermind copied to clipboard

Published 20 hours ago • verified publisher icon NethermindEth

[Unit Tests] CI - lots of flaky tests

Open MarekM25 opened this issue 3 years ago • 2 comments

We've experienced tons of tests that are failing on CI and working fine in the dev environment. The CI hangs up during some tests (random projects). It would be nice to find a solution.

MarekM25 avatar Sep 13 '21 13:09 MarekM25

Can you name a few test cases that are flaky ? It will help us in debugging..

1swaraj avatar Sep 13 '21 15:09 1swaraj

Can you name a few test cases that are flaky ? It will help us in debugging..

Just run several times our builds. I am sure that you find a lot of examples.

https://github.com/NethermindEth/nethermind/commit/3040d230fd2562114a837cd94967232e89c5e5ae https://github.com/NethermindEth/nethermind/commit/9a3a9748b4b7d170677b7122e3ef9bf5a5604c9e

MarekM25 avatar Sep 15 '21 12:09 MarekM25

one more image

smartprogrammer93 avatar Oct 12 '22 12:10 smartprogrammer93

One more image

smartprogrammer93 avatar Oct 15 '22 14:10 smartprogrammer93

Possible flaky? image

smartprogrammer93 avatar Oct 19 '22 23:10 smartprogrammer93

one more Can_produce_first_block_when_private_chains_allowed https://github.com/NethermindEth/nethermind/actions/runs/3531973485/jobs/5925764487 image

smartprogrammer93 avatar Nov 23 '22 13:11 smartprogrammer93

One more Should_allocate_by_speed_post_merge

MarekM25 avatar Jan 27 '23 12:01 MarekM25

Added a couple here: https://github.com/NethermindEth/nethermind/pull/6078. See Nethermind.JsonRpc.Test.JsonRpcSocketsClientTests.UsingWebSockets

emlautarom1 avatar Sep 14 '23 19:09 emlautarom1