shailesh837

Install ipex-llm is resulting in timeout

1

I am following new guide for installing ipex on Intel Arc 770 GPU: I added : pip install --default-timeout=100 future , But now its horrible slow https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/install_linux_gpu.html Install ipex-llm: `(llm)...

IPEX-LLM on Intel Max Series 1100 for inference libintel-ext-pt-gpu.so: undefined symbol: _ZNK5torch8autograd4Node4nameB5cxx11Ev

7

I am trying to run Synthesizing speech by TTS: https://docs.coqui.ai/en/latest/ (llm) spandey2@imu-nex-sprx92-max1-sut:~/1worldsync_finetuning$ cat tts.py ``` import torch from TTS.api import TTS from ipex_llm import optimize_model #Get device device = 'xpu'...

Speech T5 on XPU on Intel Arc GPU 770 taking 8 seconds and for CPU it takes 3 seconds ??

2

I am using from older post from : issues of ipex-llm for TTS [text to speech] I have 2 issues: a) it takes 8 seconds for TTS on XPU than...

Flex 170 GPU ollama unbale to detect GPU and sycl-ls also not detecting it !!!

3

I am testing old ollama bin file with llama2:7b model on Intel Flex 170 GPU: I have followed new ipex-llm documentation for driver install and rest steps, but when i...

Ipex-llm older ollama serve hangs after 5 minutes Intel Arc GPU 770

1

I have installed older bigdl so and it hanged with 5 minutes or running ollama serve , I was running llama2:7b model. **Bigdl version on machine:** bigdl-core-xe-21==2.5.0b20240321 bigdl-core-xe-esimd-21==2.5.0b20240321 bigdl-llm==2.5.0b20240321 intel-extension-for-pytorch==2.1.10+xpu...

microsoft/Florence-2-large Unable to perform Object Detection on Intel Arc GPU 770

4

**microsoft/Florence-2-large** Model to run on Arc 770 GPU for Object Detection on sample image. [https://huggingface.co/microsoft/Florence-2-large](https://huggingface.co/microsoft/Florence-2-large) ``` (llm_vision) spandey2@imu-nex-nuc13x2-arc770-dut:~/LLM_Computer_Vision$ pip list | grep torch intel-extension-for-pytorch 2.1.30+xpu torch 2.1.0.post2+cxx11.abi torchaudio 2.1.0.post2+cxx11.abi torchvision...

Intel(R) Arc(TM) A770M Setting as default instead of Iris Xe Graphics

1

Please can you help how can i set Intel(R) Arc(TM) A770M as default that sycl-ls instead of Device Name: Intel(R) Iris(R) Xe Graphics As **llama-cpp** is detecting Xe Graphics and...

Unable to run LanguageBind/Video-LLaVA-7B-hf using ipex

2

### Describe the bug I am getting issue running below code using ipex-llm: ``` (llm_vision) spandey2@IMU-NEX-ADLP-voice-SUT:~/LLM_Computer_Vision$ cat /etc/os-release PRETTY_NAME="Ubuntu 22.04.4 LTS" NAME="Ubuntu" VERSION_ID="22.04" VERSION="22.04.4 LTS (Jammy Jellyfish)" VERSION_CODENAME=jammy ID=ubuntu (llm_vision)...