Sreerag
Results
1
issues of
Sreerag
I tried quantizing the Qwen/Qwen2.5-VL-3B-Instruct using the below command `optimum-cli export openvino --model Qwen/Qwen2.5-VL-3B-Instruct Qwen2.5-VL-3B-Instruct\INT4 --weight-format int4` I tried inferring the quantized model using openvino.genai VLM example and getting the...
category: visual language