Roger Wang
Roger Wang
@fyabc Sorry for the late response - could you please update this branch with main again? (I was busy in the past a few days) Ideally we should be able...
@DarkLight1337 I compared this PR to #6571, and actually IMO it probably makes more sense to have this PR merged first since the video/image util is from a separate python...
I did some local testing on this PR and it's working well for both `.jpg` and `.mp4` inputs, on TP=1 and TP=2. Note that I did run into dependency issue...
> I happened to notice something while following this PR. I've merged it locally to run some tests, and during testing, I encountered a strange issue where, after several successful...
Hello there! I'm curious if supporting OpenAI Vision API is also something you're interested in since it looks like the team does plan to support vision language models from the...
Which version of `vllm` are you on? The support of `dbrx-instruct` is currently only merged to the main branch.
> Version: 0.3.3 You will need to build `vllm` from source of the main branch in order to use `dbrx-instruct`.
@Shaoting-Feng That's great to hear! I hope we can bring this together with #13350, it seems that you're already working together anyways 😄
Closing as completed in https://github.com/vllm-project/vllm/pull/14036 and #14654
> Ok the hanging issue is also solved by that PR. So it seems that the issue indeed stems from mismatched placeholders. I wonder why the scheduler hangs instead of...