litellm icon indicating copy to clipboard operation
litellm copied to clipboard

[Bug]: Image Handling with litellm Proxy for qwen-vl-plus

Open NEWbie0709 opened this issue 1 year ago • 5 comments

What happened?

I’m experiencing an issue when using litellm proxy to communicate with the qwen-vl-plus model for multimodal interactions. When I send an image URL directly to qwen-vl-plus, it processes the image as expected. However, when I configure litellm to handle the request and forward it to the qwen-vl-plus model, the same request fails. This is my config.yaml image and this is the code for testing the litellm proxy image

Other than that, I also tried using the ollama/llava model. When using the litellm proxy to send the request, it returns an error saying that it can't open the image. image image But when I directly ask the model using ollama, it can answer it. image

Relevant log output

No response

Twitter / LinkedIn details

No response

NEWbie0709 avatar Oct 18 '24 07:10 NEWbie0709