openllmetry
openllmetry copied to clipboard
🚀 Feature: Select field to send to APM or possibility to obfuscate
Which component is this feature for?
Anthropic Instrumentation
🔖 Feature description
Sometimes, some fields, like the prompt or results (completion), which are reported thru openllmetry, may contains confidentials values would need not to be reported or maybe obfuscated (replaced by **** ?).
🎤 Why is this feature needed ?
Some customers may want to observe there genAI apps but don't want confidential data at the APM level, which may appears in the prompt or the result.
✌️ How do you aim to achieve this?
give the possibility to omit or obfuscate a field, maybe through env vars?
🔄️ Additional Information
No response
👀 Have you spent some time to check if this feature request has been raised before?
- [X] I checked and didn't find similar issue
Are you willing to submit PR?
Yes I am willing to submit a PR!
Thanks @gauthiersiri! We actually have an option to disable content tracing. Did you had something else in mind?
Hi Nirga, yes we actually just saw that a few min ago :D But it seems to hide only the prompt, not the answer, or maybe we missed something?
Both
@gauthiersiri does it resolve your issue?