Phi 3.5 vision (4B model)

[CheeseAndMeat]

Model description

Lorax's official supported models does not list any vision model. This is a big gap for a very successful product. Having lorax a critical component in our tech stack without clear option of image-based language models is a big risk on our end. Can the Lorax team please prioritize on-boarding Phi3.5 vision, state of the art SML with vision? Appreciated.

https://huggingface.co/microsoft/Phi-3.5-vision-instruct

Open source status

• [X] The model implementation is available
• [X] The model weights are available

Provide useful links for the implementation

No response