langchain icon indicating copy to clipboard operation
langchain copied to clipboard

WhyLabs callback

Open jamie256 opened this issue 1 year ago • 0 comments

Add a WhyLabs callback handler

  • Adds a simple WhyLabsCallbackHandler
  • Add required dependencies as optional
  • protect against missing modules with imports
  • Add docs/ecosystem basic example

based on initial prototype from @andrewelizondo

this integration gathers privacy preserving telemetry on text with whylogs and sends stastical profiles to WhyLabs platform to monitoring these metrics over time. For more information on what WhyLabs is see: https://whylabs.ai

After you run the notebook (if you have env variables set for the API Keys, org_id and dataset_id) you get something like this in WhyLabs: Screenshot (443)

Who can review?

@agola11 @hwchase17

jamie256 avatar May 18 '23 05:05 jamie256