Joe Doucette

I have the same problem as @midnqp. PS C:\Program Files (x86)\Intel\oneAPI> .\setvars.bat :: initializing oneAPI environment... Initializing Visual Studio command-line environment... Visual Studio version 17.6.2 environment configured. "C:\Program Files\Microsoft Visual...

> @jacob1218 > > These worked for me as a workaround. https://github.com/Nuullll/intel-extension-for-pytorch/releases . It'a a fork > > Download them and install from the filesystem pip install ./package-name > >...

Confirmed on my end a chunk of the problem was command vs powershell prompt. At least at the time, the instructions weren't so clear there. https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/ollama_quickstart.html Did get me up...

One more positive note, I was able to get this build with the changes proposed by @builker to touch up VULKAN_ROOT and CAP_ROOT paths on Ubuntu 24.04. Resulting build working...

Sure -- below is failure log, starting via: export OLLAMA_NUM_GPU=999 export no_proxy=localhost,127.0.0.1 export ZES_ENABLE_SYSMAN=1 source /opt/intel/oneapi/setvars.sh export SYCL_CACHE_PERSISTENT=1 export OLLAMA_HOST=0.0.0.0:11434 2024/06/11 10:46:30 routes.go:1028: INFO server config env="map[OLLAMA_DEBUG:false OLLAMA_FLASH_ATTENTION:false OLLAMA_HOST: OLLAMA_KEEP_ALIVE:...

Thanks -- yes, I do have my GPU listed: ``` (base) doucej@kryten:~$ source /opt/intel/oneapi/setvars.sh :: initializing oneAPI environment ... bash: BASH_VERSION = 5.2.21(1)-release args: Using "$@" for setvars.sh arguments: ::...

Some notes below. I did go through and try to reinstall oneAPI, looks like indeed I had an old version on there from previous rev ubuntu most likely. Some notes:...

Realized the title was off, working with Ubuntu 24.04. I've still not been able to get a good OneAPI installation even after a clean reinstall. I was able to get...