megabots icon indicating copy to clipboard operation
megabots copied to clipboard

Published 20 hours ago • verified publisher icon momegas

Semanticly cache LLM Queries and reduce Costs

Open momegas opened this issue 1 year ago • 2 comments

momegas avatar Apr 18 '23 21:04 momegas

you can try to use the GPTCache 😆

SimFG avatar Apr 19 '23 09:04 SimFG

Yeah thats the idea. I have it in the readme 😁 Thanks for the heads up

momegas avatar Apr 19 '23 10:04 momegas