ipex-llm
ipex-llm copied to clipboard
MTL failed to run rwkv-4-world-7b: Failed to load libsycl-fallback-bfloat16.spv
MTL (Ultra 5 125H + 32GB 7467MHz) failed to run rwkv-4-world-7b.
Configured according to: https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/install_windows_gpu.html. The oneAPI is installed using pip installer. The commands I used are as follows. Don't set SYCL_CACHE_PERSISTENT and remember to change the test_api to transformer_int_gpu_win.
conda create -n your_llm python=3.9 libuv
conda activate your_llm
pip install dpcpp-cpp-rt==2024.0.2 mkl-dpcpp==2024.0.0 onednn==2024.0.0
pip install --pre --upgrade ipex-llm[xpu] -f https://developer.intel.com/ipex-whl-stable-xpu
set BIGDL_LLM_XMX_DISABLED=1
python run.py
Env
bigdl-core-xe-21 2.5.0b20240327 ipex-llm 2.1.0b20240327
And we can't find libsycl-fallback-bfloat16.spv after windows pip install in the environment, but it is there when using the offline installer or using pip install on linux.