GPTCache
GPTCache copied to clipboard
Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
### Is your feature request related to a problem? Please describe. Mini GPT4 will be interesting DEMO about how gptcache can work in the multi modality see https://github.com/Vision-CAIR/MiniGPT-4/ The input...
### Is your feature request related to a problem? Please describe. _No response_ ### Describe the solution you'd like. _No response_ ### Describe an alternate solution. _No response_ ### Anything...
### Is your feature request related to a problem? Please describe. Due to the document of openAI, we missed some major parameters of openAI document, see: https://platform.openai.com/docs/api-reference/completions/create 1. max_tokens? just...
### Is your feature request related to a problem? Please describe. For models like CLIP, and BLIP, we need to cache image as key ### Describe the solution you'd like....
### Is your feature request related to a problem? Please describe. For models working on image generation, we can store the result image in cache storage rather than just text....
### Is your feature request related to a problem? Please describe. For audio - text generation modules such as OpenAI whisper, we need to cache with audio as the key...
### Is your feature request related to a problem? Please describe. There are couple of cases where we need the idea of session and context. Let me quickly go through...
### Is your feature request related to a problem? Please describe. SQLite is good but old ### Describe the solution you'd like. Support DuckDB ### Describe an alternate solution. _No...
### Is your feature request related to a problem? Please describe. Hi. Glad someone finally made this. Been on my mind for a long time. Any chance of supporting qdrant...