qlib icon indicating copy to clipboard operation
qlib copied to clipboard

Error while running research workflow

Open a1923c opened this issue 6 months ago • 1 comments

The following error comes from "qrun benchmarks/LightGBM/workflow_config_lightgbm_Alpha158.yaml" ERROR - qlib.workflow - [utils.py:41] - An exception has been raised[OSError: dlopen(/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/lightgbm/lib/lib_lightgbm.dylib, 0x0006): Library not loaded: @rpath/libomp.dylib Referenced from: <D44045CD-B874-3A27-9A61-F131D99AACE4> /opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/lightgbm/lib/lib_lightgbm.dylib Reason: tried: '/opt/homebrew/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/homebrew/opt/libomp/lib/libomp.dylib' (no such file), '/opt/local/lib/libomp/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/local/lib/libomp/libomp.dylib' (no such file), '/opt/homebrew/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/homebrew/opt/libomp/lib/libomp.dylib' (no such file), '/opt/local/lib/libomp/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/local/lib/libomp/libomp.dylib' (no such file), '/opt/anaconda3/envs/condavenv/lib/python3.12/lib-dynload/../../libomp.dylib' (no such file), '/opt/anaconda3/envs/condavenv/bin/../lib/libomp.dylib' (no such file)]. File "/opt/anaconda3/envs/condavenv/bin/qrun", line 8, in sys.exit(run()) ^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/workflow/cli.py", line 153, in run fire.Fire(workflow) File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/fire/core.py", line 135, in Fire component_trace = _Fire(component, args, parsed_flag_args, context, name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/fire/core.py", line 468, in _Fire component, remaining_args = _CallAndUpdateTrace( ^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/fire/core.py", line 684, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/workflow/cli.py", line 147, in workflow recorder = task_train(config.get("task"), experiment_name=experiment_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/model/trainer.py", line 127, in task_train _exe_task(task_config) File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/model/trainer.py", line 45, in _exe_task model: Model = init_instance_by_config(task_config["model"], accept_types=Model) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/utils/mod.py", line 177, in init_instance_by_config klass, cls_kwargs = get_callable_kwargs(config, default_module=default_module) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/utils/mod.py", line 100, in get_callable_kwargs module = get_module_by_module_path(m_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/utils/mod.py", line 45, in get_module_by_module_path module = importlib.import_module(module_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/importlib/init.py", line 90, in import_module return _bootstrap._gcd_import(name[level:], package, level) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "", line 1387, in _gcd_import File "", line 1360, in _find_and_load File "", line 1310, in _find_and_load_unlocked File "", line 488, in _call_with_frames_removed File "", line 1387, in _gcd_import File "", line 1360, in _find_and_load File "", line 1331, in _find_and_load_unlocked File "", line 935, in _load_unlocked File "", line 999, in exec_module File "", line 488, in _call_with_frames_removed File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/contrib/model/init.py", line 9, in from .double_ensemble import DEnsembleModel File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/qlib/contrib/model/double_ensemble.py", line 4, in import lightgbm as lgb File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/lightgbm/init.py", line 11, in from .basic import Booster, Dataset, Sequence, register_logger File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/lightgbm/basic.py", line 9, in from .libpath import _LIB # isort: skip ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/lightgbm/libpath.py", line 49, in _LIB = ctypes.cdll.LoadLibrary(_find_lib_path()[0]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/ctypes/init.py", line 460, in LoadLibrary return self._dlltype(name) ^^^^^^^^^^^^^^^^^^^ File "/opt/anaconda3/envs/condavenv/lib/python3.12/ctypes/init.py", line 379, in init self._handle = _dlopen(self._name, mode) ^^^^^^^^^^^^^^^^^^^^^^^^^ OSError: dlopen(/opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/lightgbm/lib/lib_lightgbm.dylib, 0x0006): Library not loaded: @rpath/libomp.dylib Referenced from: <D44045CD-B874-3A27-9A61-F131D99AACE4> /opt/anaconda3/envs/condavenv/lib/python3.12/site-packages/lightgbm/lib/lib_lightgbm.dylib Reason: tried: '/opt/homebrew/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/homebrew/opt/libomp/lib/libomp.dylib' (no such file), '/opt/local/lib/libomp/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/local/lib/libomp/libomp.dylib' (no such file), '/opt/homebrew/opt/libomp/lib/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/homebrew/opt/libomp/lib/libomp.dylib' (no such file), '/opt/local/lib/libomp/libomp.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/opt/local/lib/libomp/libomp.dylib' (no such file), '/opt/anaconda3/envs/condavenv/lib/python3.12/lib-dynload/../../libomp.dylib' (no such file), '/opt/anaconda3/envs/condavenv/bin/../lib/libomp.dylib' (no such file)

a1923c avatar Jun 04 '25 12:06 a1923c

Please ignore the above. I fixed it by running "conda install -c conda-forge llvm-openmp".

a1923c avatar Jun 04 '25 13:06 a1923c

Hi, @a1923c Thank you for your interest in qlib. Congratulations on solving this issue. This issue will be closed shortly.

SunsetWolf avatar Sep 05 '25 13:09 SunsetWolf