outlines icon indicating copy to clipboard operation
outlines copied to clipboard

Serializing/Deserializing guides (+ caching)

Open RobinPicard opened this issue 6 months ago • 0 comments

The goal is to allow users to save/load the index to/from disk and re-use it. After this we can re-enable caching. This may require changes in outlines-core for serialization/deserialization of the index.

generator = Generator(model, OutputType)
generator.to_disk("...")

generator = Generator.from_disk("...")

Open question: should we compress large indexes?

RobinPicard avatar Jun 25 '25 07:06 RobinPicard