semantic-cache topic

List semantic-cache repositories

GPTCache

7.1k
Stars
502
Forks
39
Watchers

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.

redis-vl-python

223
Stars
35
Forks
Watchers

Redis Vector Library (RedisVL) interfaces with Redis' vector database for realtime semantic search, RAG, and recommendation systems.

ModelCache

784
Stars
40
Forks
Watchers

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.