Roger Wang
Roger Wang
Just a heads up - I did some testing and the results look fine by me, but there's still quite a bit of cleanup work needed for this PR, so...
@GSSimLtd @SinanAkkoyun I'm travelling this week so probably won't be able to take a look at this issue deeply, but could you both run `examples/openai_api_client_for_multimodal.py` and verify if the example...
I don't think guided_decoding/outlines officially supports mistral tokenizer (we still need to double check on this), and I don't think it's really vLLM's responsibility to make sure they work with...
> For now can we raise a NotImplementedError? Make with a error message that asks for a contribution if people are interested in this feature? Yea, I think that's a...
@22quinn Is this RFC considered complete?
@huachenheli Thanks for working on this - I'll review this PR and push it to the finishing line.
I’m curious: is mistral tokenizer supposed to work with guidelines? I’m asking because I’m wondering if there’s a better way to patch this.
> @WoosukKwon @ywang96 @robertgshaw2-neuralmagic > > the failed tests with ` ValueError: Cannot use apply_chat_template() because tokenizer.chat_template is not set and no template argument was passed! For information about writing...
Hello @jdf-prog! Just to confirm, you were able to launch the server, but only this particular image ran into an issue, correct?
Hmm, I was able to run inference with that image without any resizing ``` Processed prompts: 100%|█████████████████████████████████████████████████████████████████████████████████| 1/1 [00:02