Rémi Louf comments

Results 533 comments of


                                            Rémi Louf

generate.json() gives ValidationError when run with mistral-7b-instruct-v0.2.Q6_K.gguf

Can you try `generator = generate.json(model, add, whitespace_pattern="")` ?

generate.json() gives ValidationError when run with mistral-7b-instruct-v0.2.Q6_K.gguf

We may need to override `llama.cpp` default value `max_tokens=16`

Yaml Grammar

Duplicate of #923

Length constraint causes infinite looping of generation

This is not the first time this shows up, but the first time we have a report detailed enough and that we can work with. Thank you for putting the...

Length constraint causes infinite looping of generation

Should be solved by #916. Feel free to re-open if this problem persists.

Add `outlines.generate.fsm()` API entrypoint

> We should modify `RegexFSM`, to have `RegexFSM.from_interegular_fsm` This is a hint that we have a naming problem here. And we might as well fix it until more libraries depend...

Add `outlines.generate.fsm()` API entrypoint

That seems reasonable :)

Implement JSON schema field constraints

Development is now happening in `outlines-core`

Some inferences take forever to complete

Thank you so much for the detailed report! Will come back to you shortly.

Some inferences take forever to complete

It would still be nice to have results without having it in the loop, and use cProfile to understand which step "gets stuck". To get to similar experimental conditions I...