Achraf
Achraf
@rlouf I see that you added the test, I guess it's done? https://github.com/outlines-dev/outlines/blob/9f15e28edcc6c7d623dfe12445afdfafeecd1cfb/tests/generate/test_integration_vllm.py#L236
@rlouf Done.
@rlouf Using the debugger, it seems that is something related to the parser. I'm going to have a look at that.
@rlouf After inspecting a little bit, `generate.cfg` first should be fixed since it has a bug. The `def copy(self) -> "CFGGuide"` should just return `self` instead of `CFGGuide(self.cfg_string, self.tokenizer)`, it...
> That's what I feared I'm going to fix it, I'll open a draft PR when the time comes.
No problem!
@ekagra-ranjan Sorry for the late answer, there are two mechanisms that are in the works here. First, the one that gives the next possible tokens following the CFG (**tokens in...
@rlouf I'll work on this one.
Can someone please explain to me, I'm confused. Does the user have to create the FSM with `interegular` and pass it to a method `outlines.generate.fsm(fsm=interegular_fsm)` which returns the `SequenceGenerator`? I...
What do you guys think? @lapp0 @rlouf _outlines/outlines/generate/\__init\__.py_ ``` ... from .fsm import fsm ``` _outlines/outlines/generate/fsm.py_ ``` def fsm(model, fsm: FSM, sampler: Sampler = multinomial()) -> SequenceGenerator: fsm = RegexFSM.from_interegular_fsm(fsm,...