Jacoby1218

OK, so some notes: - In my testing, CLBlast is quite slow when compared to CUDA or ROCm when used with llama.cpp (I'm not using llama.cpp-python as it simply refuses...

it appears that HF Transformers might support XPU now https://github.com/huggingface/transformers/pull/25714 which would mean that even if nothing else works, this might. (no quants because no bitsandbytes, but that's also being...

Intel always manages to botch _something_ when it comes to Arc, so not surprised. Will test this out once i get my WSL2 install back working again.

> I have added an "Intel Arc" option to the one-click installer that installs the appropriate Pytorch version: [0306b61](https://github.com/oobabooga/text-generation-webui/commit/0306b61bb09fb2b5d7b42d02e90267ff62ad3173) > > The question is if it works when you try...

As of right now, there are 3 possible ways to get this to work with ARC GPUs: 1. The Intel Extension for PyTorch, which currently doesn't work on Windows. 2....

I was under the impression there were still driver issues, but if it works now that's great.

@HubKing Run "source /opt/intel/oneapi/setvars.sh" and try again. If you don't have it, make sure to install the oneAPI Basekit.

> Thanks. intel-oneapi-basekit 2024.0.0.49564-2 had been already installed and running that command solved the problem. But why did this problem happen in the first place? The user of that package...

I don't have any other GPU to test, but i can provide results from my CPU and other backends. | model | size | params | backend | threads |...

MLB THE SHOW 14 and 16 both crash with different RSX errors each time, usually unknown primitive. neither crash with interpreter.