Feature Request : Use new Anthropic Prompt Caching feature

Open numerogeek opened this issue 1 year ago • 1 comments

hi,

I received this documentation : https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching This new feature allow to cache a context so we spend less. It requires to add a new message in system part.

what do you think ?

Thank you

Dec 17 '24 22:12 numerogeek

Hey @numerogeek, yes it can be a good feature. Do you want to contribute?

Dec 31 '24 11:12 MaximeThoonsen