ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard

[bug]qwen2.5vl 3b/7b q8_0 does not work properly

Open crackerfly opened this issue 4 months ago • 1 comments

Describe the bug qwen2.5vl 3b/7b q8_0 does not work properly, text input is no problem, input image will crash randomly

32GB iGPU Share VRAM (TOTAL 64GB RAM)

ollama-ipex-llm-2.3.0b20250725-win.zip

How to reproduce Steps to reproduce the error:

  1. ollama run qwen2.5vl:7b-8_0
  2. input: what's this? D:\test.png
  3. service crash

qwen2.5vl:7b-q4_K_M works normally

crackerfly avatar Aug 04 '25 19:08 crackerfly