phoenix icon indicating copy to clipboard operation
phoenix copied to clipboard

[enhancement][playground][ui] Support gemini tool calls in playground

Open cephalization opened this issue 1 year ago • 8 comments

Tool support is currently stubbed in, mirroring openai format.

We need to write and hook up new schemas for tool definitions, tool calls, and tool results

cephalization avatar Nov 13 '24 16:11 cephalization

Search // TODO(apowell): #5348 to find effected callsites

cephalization avatar Nov 13 '24 16:11 cephalization

an example of what the tools can look like

RogerHYang avatar Nov 13 '24 18:11 RogerHYang

Hi, @cephalization. I'm Dosu, and I'm helping the Arize Phoenix team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • Enhancement request to support Gemini tool calls in the playground's UI.
  • Current support is a placeholder mimicking the OpenAI format.
  • You provided references to affected call sites.
  • @RogerHYang shared examples of potential tool designs, which you reacted positively to.

Next Steps:

  • Is this issue still relevant to the latest version of the Arize Phoenix repository? If so, please comment to keep the discussion open.
  • If there are no updates, the issue will be automatically closed in 7 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Mar 14 '25 16:03 dosubot[bot]

Is there any plan to support this? Specifically if you are looking at a trace from OpenAI and then open it in the playground your tools are auto-populated, but if you using Gemini you do not have any tools when you open the playground and are unable to add them which makes it difficult to reproduce issues in the playground if you rely on tools.

chasemcdo avatar Jun 25 '25 15:06 chasemcdo

Is there any plan to support this? Specifically if you are looking at a trace from OpenAI and then open it in the playground your tools are auto-populated, but if you using Gemini you do not have any tools when you open the playground and are unable to add them which makes it difficult to reproduce issues in the playground if you rely on tools.

Hey @chasemcdo definitely still plan on adding this. Any insight into which tools you need support for? Is it mainly funcitons?

mikeldking avatar Jun 25 '25 15:06 mikeldking

Is there any plan to support this? Specifically if you are looking at a trace from OpenAI and then open it in the playground your tools are auto-populated, but if you using Gemini you do not have any tools when you open the playground and are unable to add them which makes it difficult to reproduce issues in the playground if you rely on tools.

Hey @chasemcdo definitely still plan on adding this. Any insight into which tools you need support for? Is it mainly funcitons?

yah we use primarily function type tools

chasemcdo avatar Jun 25 '25 15:06 chasemcdo

Hi, @cephalization. I'm Dosu, and I'm helping the Arize Phoenix team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You requested enhancing the playground UI to support Gemini tool calls beyond the current OpenAI format mimicry.
  • Example Gemini tool schemas were shared by @RogerHYang to aid development.
  • The feature is recognized as important, especially for function-type tools, to better reproduce issues in the playground.
  • Maintainers are awaiting more details on tool types to help prioritize this enhancement.
  • The issue remains unresolved with ongoing plans to add Gemini support.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of Arize Phoenix by commenting here.
  • If I do not hear back within 7 days, this issue will be automatically closed.

Thank you for your understanding and contribution!

dosubot[bot] avatar Oct 29 '25 16:10 dosubot[bot]

not stale dosubot - ongoing issue

chasemcdo avatar Nov 05 '25 17:11 chasemcdo