Rémi Louf
Rémi Louf
Appears to be solved. Please reopen if that’s not the case.
At this point I think that it would only make sense to benchmark the CFG-guided generation. Regex-guided generation is only a dictionary call at each step, so there really isn't...
There's a small subtlety here. There may be several combinations of tokens that lead to either of the choices. In this case do we need to return the logprob that...
I am still not sure what the API would look like, especially since we still want `outlines.generate.choices` to return one of the choices.
> With beam search, you are guaranteed to explore all legal paths given that the number of legal paths is equal to the number of beams. This is why I...
The simplest here would still be approximate by taking multiple samples once #533 is merged. SMC on the roadmap should give better results.
Finite State Machine indeed.
What would you like to do with Outlines that you can't do with the API already?
Duplicate #953
Fixed the failing test! Could you add a simple test [here](https://github.com/outlines-dev/outlines/blob/121a25c62e46aebb3a3c9566c84717f698a9ee02/tests/generate/test_integration_vllm.py#L22) ?