Rémi Louf comments

Results 533 comments of


                                            Rémi Louf

Outlines v1 documentation

I think we should dedicate pages to how to use Outlines to connect to a vLLM server, an Ollama server, a llama.cpp server etc. It should be impossible to miss...

[Feature] Use xgrammar as default grammar backend to aviod I/O errors while using Outlines in a multi-node setting

You can deactivate Outlines' cache using: ```python from outlines import caching cachine.disable_cache() ``` And use `functool`'s `lru_cache` instead.

Fix IndexError caused by invalid token IDs in CFGGuide

Thank you for contributing! Could you add a test that fails on current `main` and passes here?

Fix IndexError caused by invalid token IDs in CFGGuide

Thank you for making the change :) Is it good for review?

Fix IndexError caused by invalid token IDs in CFGGuide

We deprecated the old CFG backend in favor of integrating xgrammar and llguidance.

Outlines Transformers requires a ton more VRAM

Thanks for reporting the issue! FYI `transformers` uses greedy sampling by default: https://huggingface.co/docs/transformers/en/main_classes/text_generation

Add non-docstring alternative for prompts

This has been bothering me for a while too, thank you for contributing! I think we might as well _return_ the template. This would allow string manipulations within the function...

Add non-docstring alternative for prompts

> This has been bothering me for a while too, thank you for contributing! I think we might as well _return_ the template. This would allow string manipulations within the...

Prompting: response_model | schema does not work with Enum

Thanks! Feel free to open a PR to fix this, it shouldn't be a big change to the current logic.

Add `Outline`s

> Fix #1346, WDYT about the integration with `outlines.prompt`? We should allow functions that are not decorated, such as ```python def build_prompt(a: int) -> str: return f"What is {a} squared?"...