Rahul Atlury
Rahul Atlury
Yes I will put together a 64 bit ubuntu 16.0.4 or 16.10 with a mainline kernel. Please be patient
Any update on the Qwen2-VL (vision models) support?
ok I will look in it then....thank you
Thank you!
Yes thanks @CharlieFRuan. I understand its quantized but will it have such a large difference? I will wait for your results.
@TomLucidor I havent seen much benchmarks in terms of accuracy for quantized vs unquantized models especially for the above vision models. I plan to try out the openvino version.... I...
I think allen ai is more open and i guess molmo is well described, we should attempt to support it and more vision models!
Yes, a lot of us would like to have the vision models support.....