shailesh837
shailesh837
I am following new guide for installing ipex on Intel Arc 770 GPU: I added : pip install --default-timeout=100 future , But now its horrible slow https://ipex-llm.readthedocs.io/en/latest/doc/LLM/Quickstart/install_linux_gpu.html Install ipex-llm: `(llm)...
I am trying to run Synthesizing speech by TTS: https://docs.coqui.ai/en/latest/ (llm) spandey2@imu-nex-sprx92-max1-sut:~/1worldsync_finetuning$ cat tts.py ``` import torch from TTS.api import TTS from ipex_llm import optimize_model #Get device device = 'xpu'...
I am using from older post from : issues of ipex-llm for TTS [text to speech] I have 2 issues: a) it takes 8 seconds for TTS on XPU than...
I am testing old ollama bin file with llama2:7b model on Intel Flex 170 GPU: I have followed new ipex-llm documentation for driver install and rest steps, but when i...
I have installed older bigdl so and it hanged with 5 minutes or running ollama serve , I was running llama2:7b model. **Bigdl version on machine:** bigdl-core-xe-21==2.5.0b20240321 bigdl-core-xe-esimd-21==2.5.0b20240321 bigdl-llm==2.5.0b20240321 intel-extension-for-pytorch==2.1.10+xpu...
**microsoft/Florence-2-large** Model to run on Arc 770 GPU for Object Detection on sample image. [https://huggingface.co/microsoft/Florence-2-large](https://huggingface.co/microsoft/Florence-2-large) ``` (llm_vision) spandey2@imu-nex-nuc13x2-arc770-dut:~/LLM_Computer_Vision$ pip list | grep torch intel-extension-for-pytorch 2.1.30+xpu torch 2.1.0.post2+cxx11.abi torchaudio 2.1.0.post2+cxx11.abi torchvision...
Please can you help how can i set Intel(R) Arc(TM) A770M as default that sycl-ls instead of Device Name: Intel(R) Iris(R) Xe Graphics As **llama-cpp** is detecting Xe Graphics and...
### Describe the bug I am getting issue running below code using ipex-llm: ``` (llm_vision) spandey2@IMU-NEX-ADLP-voice-SUT:~/LLM_Computer_Vision$ cat /etc/os-release PRETTY_NAME="Ubuntu 22.04.4 LTS" NAME="Ubuntu" VERSION_ID="22.04" VERSION="22.04.4 LTS (Jammy Jellyfish)" VERSION_CODENAME=jammy ID=ubuntu (llm_vision)...