Victoria Terenina
Victoria Terenina
`outlines-core` v0.2 introduces major interface changes, which require additional work on the `outlines` side. Currently in `outlines` we're importing these from `outlines_core`: ```python from outlines_core.fsm.guide import Generate from outlines_core.fsm.guide import...
This is a reminder to reconsider turning on caching for the guide, which was turned off due to pickling issues of python bindings provided by `outlines-core`: https://github.com/dottxt-ai/outlines/pull/1278 Most likely this...
Automatically generate python interface files, investigate what's more appropriate: - `mypy-stubgen` - `pybind11-stubgen` - custom script
Repository needs to be restructured and python bindings to be separated from the core rust interfaces, which are currently all mixed and tied together, difficult to extend and support and...
We would like to keep the size of `Error` as small as possible (currently, it's 48 bytes already). So it needs to be defined as a struct with `Box`ed inner...
We need to investigate serialization options after python bindings will stabilize (and loose many intermediary structures we have to support right now). One solution was introduced with `bincode` and `Python::with_gil`,...
Parsing logic of `json_schema` is written in python style and creates many unnecessary allocations/deallocations, which could be re-written much more efficiently.
`json_schema` might be a good candidate for property based testing.