aisuite icon indicating copy to clipboard operation
aisuite copied to clipboard

Add observability and security part of the providers

Open subramanya1997 opened this issue 1 year ago • 2 comments

It would be great to see basic observability and security features integrated directly into BaseProvider class.

Observability:

  1. Logging: Track API calls, errors, and performance metrics for better debugging.
  2. Tracing: Integrate with OpenTelemetry for distributed tracing across providers.
  3. Metrics: Expose latency, throughput, and error rates to monitor provider performance.

Security:

  1. Input Validation: Mitigate risks like prompt injection and ensure PII masking.
  2. Response Filtering: Enable moderation to filter sensitive or unsafe outputs.

These features would enhance reliability, transparency, and safety.

subramanya1997 avatar Nov 28 '24 01:11 subramanya1997

Can i pick this up?

abhiramvad avatar Nov 29 '24 08:11 abhiramvad

Added this Pull Request for logging and observability. Will add a PR for security and performance metrics once this is merged

abhiramvad avatar Nov 29 '24 19:11 abhiramvad