opik icon indicating copy to clipboard operation
opik copied to clipboard

[FR]: Replay OpenAI LLM Spans in the playground

Open jverre opened this issue 3 months ago • 4 comments

Context: When working on an LLM agent, you sometimes want to make a small change to a prompt and quickly understand it's impact. Given that Opik already includes a Prompt Playground, it would be great if we could open an LLM span in the playground.

Feature implementation:

The goal of this feature is to add an icon next to these three icons in the traces sidebar:

Image

When a user clicks on the icon, they will be redirected to the playground and the messages in the span input will be already loaded. This will then allow the user to change the messages and see the response.

Implementation considerations:

  • Before we display the button we will need to check that the LLM span input follows the OpenAI format or at least contains a message array of the right format

jverre avatar Sep 25 '25 21:09 jverre

@jverre @vincentkoc , I would like to work on the issue. Can you please assign this to me.

DhanashreePetare avatar Oct 01 '25 06:10 DhanashreePetare

@DhanashreePetare please start on this one, depending on how you go can assign more as PRs are raised and merged. Would like to give others a chance too.

vincentkoc avatar Oct 01 '25 08:10 vincentkoc

Hi @jverre @vincentkoc , Could you please review this PR - https://github.com/comet-ml/opik/pull/3724

Thanks :)

sonianuj287 avatar Oct 20 '25 05:10 sonianuj287

Hi @jverre @vincentkoc , sorry for spamming the comments. Mistakenly I removed forked repo, so I repushed the code. please check

sonianuj287 avatar Oct 20 '25 08:10 sonianuj287