AutoGPT icon indicating copy to clipboard operation
AutoGPT copied to clipboard

Published 20 hours ago • verified publisher icon Significant-Gravitas

Adding OpenAI Observability Dashboard Capability

Open su77ungr opened this issue 2 years ago • 2 comments

Background

Created optional integration to monitor all OpenAI traffic. By integrating OpenAI Observability Tool from New Relic: New Relic is focused on delivering valuable AI and ML tools that provide in-depth monitoring insights and integrate with your current technology stack. Our industry-first MLOps integration with OpenAI’s GPT-3, GPT-3.5, and beyond provides a seamless path for monitoring this service. Our lightweight library helps you monitor OpenAI completion queries and simultaneously records useful statistics around ChatGPT in a New Relic dashboard about your requests.

image

Changes

Just adds an API key and the initialize.monitor call in the main.py

module used: nr-openai-observability

Repo: https://github.com/newrelic/nr-openai-observability

Documentation

Test Plan

Tested with inactive key. No changes made in the .env file. Active also works. It's passive and optional.

PR Quality Checklist

  • [x] My pull request is atomic and focuses on a single change.
  • [ ] I have thoroughly tested my changes with multiple different prompts.
  • [x] I have considered potential risks and mitigations for my changes.
  • [x] I have documented my changes clearly and comprehensively.
  • [x] I have not snuck in any "extra" small tweaks changes

su77ungr avatar Apr 16 '23 02:04 su77ungr

Seems very useful, I support adding this functionality

jacobtohahn avatar Apr 16 '23 02:04 jacobtohahn

This pull request has conflicts with the base branch, please resolve those so we can evaluate the pull request.

github-actions[bot] avatar Apr 17 '23 15:04 github-actions[bot]

Hello!

We sincerely appreciate your contribution to our project. Please note that only essential features will be merged into the main repository. Thus, we encourage you to open a pull request in the Auto-GPT-Plugins repository.

If you encounter any difficulties in converting your code into a plugin, please do not hesitate to seek assistance from the #plugins-chat on our Discord Server.

We look forward to your contribution to the Plugins repository, and we apologize for any inconvenience this may have caused.

hdkiller avatar Apr 23 '23 19:04 hdkiller