Rémi Louf comments

Results 533 comments of


                                            Rémi Louf

Are we able to structure JSON output into a single line with just one whitespace?

I've been wondering if we should restrict the default pattern a little more to accept a maximum of 4 white spaces and one line break? That seems like a reasonable...

Are we able to structure JSON output into a single line with just one whitespace?

Fair. We can give it a try and see if we still get complaints from users.

Are we able to structure JSON output into a single line with just one whitespace?

This was addressed by #916, closing for now.

RuntimeError with Tensors on Different Devices When Using Outlines

Looks like we need to make sure `sequence_weights` and `logprobs` should be on the same device somewhere upstream.

`outlines.generate.choice` generates tkens other than provided choices - special tokens being added to tokenizer incorrectly?

Pinging @lapp0

Use a trie to speed up index construction

Could you add a high-level description of what the PR does so the PR is self-contained? Is there an issue we could link to this PR? Also there is no...

Test the CFG integration for `llama.cpp`

I agree on fixing issues in `parsing.py` first.

Check benchmarks in CI

Note that we should track both execution speed and memory usage.

Llamacpp has Attributeerror with token_eos for Hermest-Pro-7B when using structured grammar generation

I am so sorry this is happening! I will investigate early next week.

Llamacpp has Attributeerror with token_eos for Hermest-Pro-7B when using structured grammar generation

Yes, it would have fixed it. Please update outlines to use the latest version and give it another try.