burr icon indicating copy to clipboard operation
burr copied to clipboard

Prompt playground

Open zilto opened this issue 5 months ago • 1 comments

Allows to load traces from tracked Burr application with OpenLLMetry traces.

You can load previous chat interactions and try new prompts with multiple LLM providers via LiteLLM.

image

To launch the app

OPENAI_API_KEY=sk-... ANTHROPIC_API_KEY=sk-ant-... streamlit run burr/integrations/playground/app.py

Features:

  • 3 providers at once
  • load interactions directly from local Burr tracking
  • load a specific interaction via the URL params
  • the playground interactions themselves are logged using Burr under burr-playground

Limitations:

  • streamlit makes it very inconvenient to call LLMs asynchronously
  • currently no streamlined way to support generic API key input

zilto avatar Sep 06 '24 16:09 zilto