openllmetry icon indicating copy to clipboard operation
openllmetry copied to clipboard

🚀 Feature: Select field to send to APM or possibility to obfuscate

Open gauthiersiri opened this issue 1 year ago • 4 comments

Which component is this feature for?

Anthropic Instrumentation

🔖 Feature description

Sometimes, some fields, like the prompt or results (completion), which are reported thru openllmetry, may contains confidentials values would need not to be reported or maybe obfuscated (replaced by **** ?).

🎤 Why is this feature needed ?

Some customers may want to observe there genAI apps but don't want confidential data at the APM level, which may appears in the prompt or the result.

✌️ How do you aim to achieve this?

give the possibility to omit or obfuscate a field, maybe through env vars?

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

  • [X] I checked and didn't find similar issue

Are you willing to submit PR?

Yes I am willing to submit a PR!

gauthiersiri avatar Oct 17 '24 13:10 gauthiersiri

Thanks @gauthiersiri! We actually have an option to disable content tracing. Did you had something else in mind?

nirga avatar Oct 17 '24 13:10 nirga

Hi Nirga, yes we actually just saw that a few min ago :D But it seems to hide only the prompt, not the answer, or maybe we missed something?

gauthiersiri avatar Oct 17 '24 13:10 gauthiersiri

Both

nirga avatar Oct 17 '24 16:10 nirga

@gauthiersiri does it resolve your issue?

nirga avatar Nov 09 '24 20:11 nirga