openllmetry icon indicating copy to clipboard operation
openllmetry copied to clipboard

Published 20 hours ago • verified publisher icon traceloop

🚀 Feature: Support Prompt Caching

Open nirga opened this issue 1 year ago • 5 comments

Which component is this feature for?

Anthropic Instrumentation

🔖 Feature description

Support logging of prompt caching, including cached token usage:

https://docs.anthropic.com/en/docs/build-with-claude/prompt-caching#how-can-i-track-the-effectiveness-of-my-caching-strategy

🎤 Why is this feature needed ?

✌️ How do you aim to achieve this?

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

  • [X] I checked and didn't find similar issue

Are you willing to submit PR?

None

nirga avatar Aug 14 '24 20:08 nirga

Hi @nirga, can I work on this task?

rxailab avatar Aug 16 '24 10:08 rxailab

Yes! Thank you :) @samsmithspace

nirga avatar Aug 16 '24 10:08 nirga

Hi @samsmithspace are you still working on it?

kowshik24 avatar Aug 16 '24 22:08 kowshik24

Hi @nirga I have updated the prompt caching. Could you please check?

kowshik24 avatar Aug 16 '24 23:08 kowshik24

is it still open for contribution?

Karush2807 avatar Oct 01 '24 19:10 Karush2807

@dinmukhamedm this is fixed with #2175 right?

nirga avatar Nov 09 '24 19:11 nirga