sglang
sglang copied to clipboard
for llava, how to send image rather than image_path?
current example(srt_example_llava.py) request like this: state = image_qa.run( image_path="./images/cat.jpeg", question="What is this?", max_new_tokens=64 )
but, if i want to send request like below, what should I do? request = { "text": ["What is this?".encode()], "images": [open("./images/cat.jpeg", "rb").read()] }