joshpopelka20

Thanks for working on these changes! I'm really looking forward to testing [#350](https://github.com/EricLBuehler/mistral.rs/pull/350). I have a question about [#366](https://github.com/EricLBuehler/mistral.rs/pull/366). I see the cache is being saved to disk. Based on...

Thanks for that explanation. It makes sense to me now. Also, it does seem like a nice use case for Redis. Looking forward to that future change if you choose...

Fyi, this is my current prompt: ``` You will be searching for cancer terms in a given text and providing context for any matches found. Follow these instructions carefully: 1....

Is there any documentation of the use case? I'm not seeing why this was closed