Rémi Louf
Rémi Louf
Would you mind removing the `pytest.mark.xfail` decorator? The test is not run currently.
Ok I'll update the vLLM install so we can run these tests in CI. I'll edit your PR directly so don't touch anything for now!
I get an error on the CFG test, it generates tokens that are not allowed. We need to determine if it's a problem with the CFGGuide or the integration itself....
That's what I feared
Thank you! I'm sorry for lack of responsiveness here, I'm really busy with other things but will have more time soon :)
Yes it was supposed to be LangChain, thank you 😅
Thank you for opening an issue! It looks like something we should be able to support. Do you mind pasting the JSON schema for these 3 models here?
It should work (with fixed depth). Implementation is in `outlines-core`.
Is this with a fresh virtual environment? I was unable to reproduce the issue.
That's an interesting use case. You could build the string-based FSM really easily by hand, and you could probably write a regex for it but that could end up being...