redflag icon indicating copy to clipboard operation
redflag copied to clipboard

`is_standard_normal` test is flaky

Open kwinkunks opened this issue 2 years ago • 3 comments

Relax confidence level? Or could seed it.

Weirdly only seems flaky on Python 3.8.

image

kwinkunks avatar Sep 04 '23 05:09 kwinkunks

Argh, still flaky. Clearly this test is not as robust as I hoped, maybe need to use something other than (or in addition to?) K-S.

kwinkunks avatar Sep 04 '23 06:09 kwinkunks

Temporarily fixed this byusing default_rng with a seed -- but would rather have a test that a decent sample passes on.

kwinkunks avatar Sep 20 '23 19:09 kwinkunks

Much better now but failed again on 3.9 here https://github.com/scienxlab/redflag/actions/runs/6385283773

kwinkunks avatar Oct 02 '23 20:10 kwinkunks