Brandon T. Willard
Brandon T. Willard
> I've changed the PR to explicitly set the cache key computation using the `key_function` parameter of the `@cache()` decorator. This is in line with the discussion in #876. >...
This might be the actual issue I was seeing in #853.
This should be possible with [CFG-structured generation](https://outlines-dev.github.io/outlines/reference/cfg/). There's a `lark` grammar for YAML [here](https://github.com/ligurio/lark-grammars/blob/master/lark_grammars/grammars/yaml.lark), but it might need to be changed in order to properly support any parser restrictions the...
> Would an alternative be to devise a function that will compute a unique hash given the current class members? This would not require changing the API. Yes, that would...
Closing this since it was covered by #911, which also required fixes unrelated to #872.
Here are some examples of integer range constraints expressed as regular expressions: https://stackoverflow.com/a/34680927/3006474, https://3widgets.com/
> To be honest I switched to ggml’s ebnf for grammar constraints. How does an EBNF-specified grammar provide these constraints?
> While playing around trying to validate meta schemas, I ran into `$recursiveRef` or `$dynamicRef`, any thoughts on implementation of recursive schemas? I'd like to give it a try Regarding...
These timing results contain significant non-inference setup steps (e.g. `json(model, dumps(output_format))`).
@rlouf @lapp0