ert icon indicating copy to clipboard operation
ert copied to clipboard

GUI tests fail locally due to order dependency

Open berland opened this issue 3 years ago • 0 comments

Describe the bug

(3.8.b) [havb@be-lx895926:/work/projects/ert/tests/ert_tests/gui] stop-underlying-leak-fixing-3613$ pytest test_gui_load.py -x  # fails
==================================================== test session starts ====================================================
platform linux -- Python 3.8.13, pytest-7.1.2, pluggy-1.0.0
PyQt5 5.15.7 -- Qt runtime 5.15.2 -- Qt compiled 5.15.2
benchmark: 3.4.1 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)
rootdir: /work/projects/ert, configfile: pyproject.toml
plugins: anyio-3.6.1, ert-storage-0.3.15, dash-2.6.1, timeout-2.1.0, snapshot-0.9.0, raises-0.11, qt-4.1.0, mock-3.8.2, cov-3.0.0, benchmark-3.4.1, asyncio-0.19.0
asyncio: mode=auto
collected 4 items                                                                                                           

test_gui_load.py ..F

========================================================= FAILURES ==========================================================
_____________________________________________________ test_gui_iter_num _____________________________________________________
CALL ERROR: Exceptions caught in Qt event loop:
________________________________________________________________________________
Traceback (most recent call last):
  File "/work/projects/ert/tests/ert_tests/gui/test_gui_load.py", line 141, in _assert_iter_in_args
    assert panel.getSimulationArguments().iter_num == 10
AttributeError: 'Arguments' object has no attribute 'iter_num'
________________________________________________________________________________
--------------------------------------------------- Captured stderr call ----------------------------------------------------
Exceptions caught in Qt event loop:
________________________________________________________________________________
Traceback (most recent call last):
  File "/work/projects/ert/tests/ert_tests/gui/test_gui_load.py", line 141, in _assert_iter_in_args
    assert panel.getSimulationArguments().iter_num == 10
AttributeError: 'Arguments' object has no attribute 'iter_num'
________________________________________________________________________________
================================================== short test summary info ==================================================
FAILED test_gui_load.py::test_gui_iter_num
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! stopping after 1 failures !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
================================================ 1 failed, 2 passed in 1.73s ================================================
                                                                                                                                            

To reproduce

cd tests/ert_tests/gui
pytest test_gui_load.py::test_gui_iter_num  # succeeds
pytest test_gui_load.py -x  # fails
pytest test_gui_load.py::test_gui_iter_num test_gui_load.py::test_gui_full  # succeeds
pytest test_gui_load.py::test_gui_full test_gui_load.py::test_gui_iter_num  # fails

Expected behaviour No dependency on order

Environment

  • OS: RHEL7
  • ERT/Komodo release: bleeding
  • Python version: 3.8
  • Remote/HPC execution involved:no

berland avatar Aug 09 '22 11:08 berland