Have you tested MiniCPM-o-2_6 ?

[Greatz08]

https://huggingface.co/openbmb/MiniCPM-o-2_6

Have you thought about testing this model ? I am finding it interesting as Minicpm team is developing good models since last year plus they are using some great bases for their model, btw i didn't tested this latest one yet but it claim great results under small weights (8B) so if you can add support for it or test it locally somehow to see if it is able to give similar vision performance like proprietary models, then it will be great thing for many users like me :-)