worker-vllm
worker-vllm copied to clipboard
Qwen/Qwen2-VL-7B-Instruct
Can I use Qwen/Qwen2-VL-7B-Instruct model with images? Is yes how?
Here is my code:
response = client.chat.completions.create(
model="Qwen/Qwen2-VL-7B-Instruct",
messages=[
{
"role": "user",
"content": [
{
"type": "image",
"image": "https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-VL/assets/demo.jpeg",
},
{"type": "text", "text": "Describe this image."},
],
}
],
temperature=0,
max_tokens=100,
)
print(response)
NotImplementedError: Unknown part type: image
Did you find a solution to this?
Hi! @faleandroid. No actually I didn't get into this later on. I will check and let you know
+1