Flaky test integration_tests/storage/test_parameter_sample_types.py::test_surface_param_update

[eivindjahren]

integration_tests/storage/test_field_parameter.py::test_field_param_update also fails with the same error message.

https://github.com/equinor/ert/actions/runs/8522601524/job/23343258128?pr=7530 https://github.com/equinor/ert/actions/runs/8522710228/job/23343573807 https://github.com/equinor/ert/actions/runs/8519070513/job/23332439537 https://github.com/equinor/ert/actions/runs/8519070513/job/23332428110 https://github.com/equinor/ert/actions/runs/8524062476/job/23348244278?pr=7535

[eivindjahren]

This seems related to #7522

[xjules]

integration_tests/storage/test_field_parameter.py::test_field_param_update also fails with the same error message.

https://github.com/equinor/ert/actions/runs/8522601524/job/23343258128?pr=7530 https://github.com/equinor/ert/actions/runs/8522710228/job/23343573807 https://github.com/equinor/ert/actions/runs/8519070513/job/23332439537 https://github.com/equinor/ert/actions/runs/8519070513/job/23332428110 https://github.com/equinor/ert/actions/runs/8524062476/job/23348244278?pr=7535

So far, no success in reproducing it locally. Have tried the following:

pytest -svv tests/integration_tests/storage/test_parameter_sample_types.py::test_surface_param_update --count 100
pytest -svv tests/integration_tests/storage/test_parameter_sample_types.py::test_surface_param_update -n8 --count 100

[eivindjahren]

@xjules Maybe it can be reproduced with the following?

pytest tests/integration_tests/storage/test_parameter_sample_types.py -n8 --count 100

[xjules]

@xjules Maybe it can be reproduced with the following?

pytest tests/integration_tests/storage/test_parameter_sample_types.py -n8 --count 100

have tried this

pytest tests/integration_tests/storage/test_parameter_sample_types.py -n8 --count 50

and got:

FAILED tests/integration_tests/storage/test_parameter_sample_types.py::test_surface_param_update[39-50] - Failed: Timeout >360.0s
FAILED tests/integration_tests/storage/test_parameter_sample_types.py::test_surface_param_update[47-50] - Failed: Timeout >360.0s

which I guess is a different error (but still a flaky behavior though).

It really seems that Scheduler is very "fast" to shutdown itself :shrug:

[eivindjahren]

I have also observed that problem. Seems like the problem is that monitor is hanging? These processes should be linked.

[xjules]

Might be resolved by https://github.com/equinor/ert/pull/7562

[eivindjahren]

Think this might be related: https://github.com/equinor/ert/actions/runs/8568848332/job/23483664236?pr=7572

[xjules]

Solved by https://github.com/equinor/ert/pull/7562

[oyvindeide]

I got this again, but the symptoms look a bit different, any idea if it could be related? https://github.com/equinor/ert/actions/runs/9096046868/job/25000718729?pr=7906

[xjules]

This might be related to the following: https://github.com/equinor/ert/pull/7901

[xjules]

@oyvindeide it might have been fixed by https://github.com/equinor/ert/pull/8015 Let's see it the error happens again.

[xjules]

Haven't seen this this since the potential fixture so closing this issue.