eosphoros-ai
[Feature]: Reduce the llm request count for the low time cost
Is your feature request related to a problem? Please describe.
Awesome project!!! I will take less time to write duplicate or similar sql. Usually llm reasoning takes a long time, and it takes longer to process Chinese than English. Maybe there are some ways to reduce the response time, and at the same time reduce the pressure on computer resources. And I believe it will make the project more attractive.
Describe the solution you'd like
GPTCache is a semantic cache library for LLMs, and it's fully integrated with LangChain and llama_index. Also when you encounter some problems about the usage, I am willing to provide a range of help.
It‘s cool! We will use it, and look forward to some interesting things happening, stay in touch...
