GPTCache

GPTCache copied to clipboard

Is your feature request related to a problem? Please describe.

Hi. Glad someone finally made this. Been on my mind for a long time. Any chance of supporting qdrant as a vector store? Qdrant also allows filtering by metadata which can be helpful if you only want to retrieve cache from within a certain date range for example. Qdrant can also store the llm response as metadata which eliminates the sqlite requirement. The new qdrant local mode means you dont have to setup a server via docker. Just install from pip and you are ready to go.

Describe the solution you'd like.

No response

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

qdrant is on the list, please stay tuned.

we actually has a pr for this. If you want to implement the local mode version on yourself that would be highly welcomed

Any update on this?

anyone interesting could take on the pr and work on this

Happy to start working on this!

Happy to start working on this!

Please take it and open an issue~ Anyone would like to work on any vector store is warmly welcomed~

@parthvnp any update on qdrant?

@Torhamilton It will be ready by this Saturday!

@parthvnp looking forward to your pr

@parthvnp Hey~ how about the project update?

@DumoeDss @Torhamilton Sorry for the delay. I have created a PR

@parthvnp Thanks your contribution!!! The next GPTCache version will support the qdrant vector database. @DumoeDss @Torhamilton @dagthomas