[Flaky test] Segfault in `test_runtime_module_load.py::test_combine_module_llvm`

[driazati]

trafficstars

These tests were found to be flaky (intermittently failing on main or failed in a PR with unrelated changes). As per the docs, these failures will be disabled in a PR that references this issue until the test owners can fix the source of the flakiness.

Test(s)

• tests/python/unittest/test_runtime_module_load.py::test_combine_module_llvm

[2022-08-04T20:40:10.612Z] tests/python/unittest/test_runtime_module_load.py::test_combine_module_llvm [20:40:10] ../src/target/target_kind.cc:163: Warning: Unable to detect CUDA version, default to "-arch=sm_20" instead
[2022-08-04T20:40:10.612Z] Fatal Python error: Segmentation fault
[2022-08-04T20:40:10.612Z] 
[2022-08-04T20:40:10.612Z] Thread 0xbbeaeb40 (most recent call first):
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/concurrent/futures/thread.py", line 78 in _worker
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 870 in run
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 926 in _bootstrap_inner
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 890 in _bootstrap
[2022-08-04T20:40:10.612Z] 
[2022-08-04T20:40:10.612Z] Thread 0xbc6afb40 (most recent call first):
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/concurrent/futures/thread.py", line 78 in _worker
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 870 in run
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 926 in _bootstrap_inner
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 890 in _bootstrap
[2022-08-04T20:40:10.612Z] 
[2022-08-04T20:40:10.612Z] Thread 0xf5170b40 (most recent call first):
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/socket.py", line 212 in accept
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pytest_rerunfailures.py", line 429 in run_server
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 870 in run
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 926 in _bootstrap_inner
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/threading.py", line 890 in _bootstrap
[2022-08-04T20:40:10.612Z] 
[2022-08-04T20:40:10.612Z] Current thread 0xf7bb2ac0 (most recent call first):
[2022-08-04T20:40:10.612Z]   File "/workspace/python/tvm/_ffi/_ctypes/packed_func.py", line 233 in __call__
[2022-08-04T20:40:10.612Z]   File "/workspace/python/tvm/runtime/module.py", line 559 in system_lib
[2022-08-04T20:40:10.612Z]   File "/workspace/tests/python/unittest/test_runtime_module_load.py", line 214 in check_system_lib
[2022-08-04T20:40:10.612Z]   File "/workspace/tests/python/unittest/test_runtime_module_load.py", line 223 in test_combine_module_llvm
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/python.py", line 192 in pytest_pyfunc_call
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_callers.py", line 39 in _multicall
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_manager.py", line 80 in _hookexec
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_hooks.py", line 265 in __call__
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/python.py", line 1761 in runtest
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/runner.py", line 166 in pytest_runtest_call
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_callers.py", line 39 in _multicall
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_manager.py", line 80 in _hookexec
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_hooks.py", line 265 in __call__
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/runner.py", line 259 in <lambda>
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/runner.py", line 338 in from_call
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/runner.py", line 259 in call_runtest_hook
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/runner.py", line 219 in call_and_report
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/runner.py", line 130 in runtestprotocol
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pytest_rerunfailures.py", line 497 in pytest_runtest_protocol
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_callers.py", line 39 in _multicall
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_manager.py", line 80 in _hookexec
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_hooks.py", line 265 in __call__
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/main.py", line 347 in pytest_runtestloop
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_callers.py", line 39 in _multicall
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_manager.py", line 80 in _hookexec
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_hooks.py", line 265 in __call__
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/main.py", line 322 in _main
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/main.py", line 268 in wrap_session
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/main.py", line 315 in pytest_cmdline_main
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_callers.py", line 39 in _multicall
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_manager.py", line 80 in _hookexec
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pluggy/_hooks.py", line 265 in __call__
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/config/__init__.py", line 165 in main
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/_pytest/config/__init__.py", line 187 in console_main
[2022-08-04T20:40:10.612Z]   File "/usr/local/lib/python3.7/dist-packages/pytest/__main__.py", line 5 in <module>
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/runpy.py", line 85 in _run_code
[2022-08-04T20:40:10.612Z]   File "/usr/lib/python3.7/runpy.py", line 193 in _run_module_as_main
[2022-08-04T20:40:10.612Z] tests/scripts/setup-pytest-env.sh: line 49:  4069 Segmentation fault      TVM_FFI=${ffi_type} python3 -m pytest -o "junit_suite_name=${suite_name}" "--junit-xml=${TVM_PYTEST_RESULT_DIR}/${suite_name}.xml" "--junit-prefix=${ffi_type}" "${extra_args[@]}"

Jenkins Links

• https://ci.tlcpack.ai/blue/rest/organizations/jenkins/pipelines/tvm/branches/main/runs/3973/nodes/356/steps/858/log/?start=0