LibreChat icon indicating copy to clipboard operation
LibreChat copied to clipboard

Enhancement: Support Custom Endpoint Anthropic prompt caching

Open FeepingCreature opened this issue 1 year ago • 13 comments

What features would you like to see added?

https://openrouter.ai/docs/prompt-caching

Implemented for Claude 3 only, but it's there! It would be great to have this available in LibreChat. I frequently run very long conversations that end up very expensive per query; I'd love to be able to cache.

More details

Which components are impacted by your request?

No response

Pictures

No response

Code of Conduct

  • [X] I agree to follow this project's Code of Conduct

FeepingCreature avatar Sep 08 '24 15:09 FeepingCreature