ipex-llm
ipex-llm copied to clipboard
[bug]qwen2.5vl 3b/7b q8_0 does not work properly
Describe the bug qwen2.5vl 3b/7b q8_0 does not work properly, text input is no problem, input image will crash randomly
32GB iGPU Share VRAM (TOTAL 64GB RAM)
ollama-ipex-llm-2.3.0b20250725-win.zip
How to reproduce Steps to reproduce the error:
- ollama run qwen2.5vl:7b-8_0
- input: what's this? D:\test.png
- service crash
qwen2.5vl:7b-q4_K_M works normally