Simon Lui

The packages are there at https://developer.intel.com/ipex-whl-stable-xpu which you can browse, pip just isn't picking them up for whatever reason now with the URL. You need to manually install the packages...

> 1. The Intel Extension for PyTorch, which currently doesn't work on Windows. As I posted in https://github.com/oobabooga/text-generation-webui/issues/3761#issuecomment-1771257122, Windows does work with Intel Extension for Pytorch but you need to...

Let me know if you need help with the Docker images setup but it should be self explanatory to set up. If you use the base Dockerfile, you will get...

Sorry for the late reply. The issue seems to be with the GPG key you have retrieved which is from Intel itself, and I believe the command that fetches and...

Any updates with this issue?

> The fact that it is taking weeks to locate an Intel GPU at Intel is really not inspiring much confidence and AMD is coming out with a cheap 16GB...

> I think we have different definitions of "path forward". You are saying the path forward is to stay in the past and just run an old version. Also, the...

>If you have an easier way to reproduce the issue, that would be most helpful and can speed up the time to resolve it. The main issue seems to be...

> After debugging and tracing a little bit, I suspect the issue is originating from "forward" function in Class CrossAttention. > > q,k,v all have dtype of torch.float16. > But...

Sorry, I didn't have time until now to check and reply to this until now. a.) The docker arrangement works with a Nvidia GPU on another machine I had access...