Prompt Caching

[redeux]

Users should have a way to cache prompts so that they can improve the performance of their app and reduce GPT query spend.

MVP should be a local query, suitable for local development.

Enhancements will probably start with Redis, possibly with VSS.

If you have another use case or idea, please leave a comment.