phoenix icon indicating copy to clipboard operation
phoenix copied to clipboard

[BUG]: trace from gemini only partially added to a dataset

Open vincentventalon opened this issue 8 months ago • 1 comments

Where do you use Phoenix

Container (self-hosted)

What version of Phoenix are you using?

7.12.2

What operating system are you seeing the problem on?

GCP cloud run container

What version of Python are you running Phoenix with?

3.10

What version of Python or Node are you using instrumentation with?

3.10

What instrumentation are you using?

No response

What happened?

When adding a trace to a dataset

Input and output are empty showing only "role".

Image

What did you expect to happen?

The question and LLM answer are also added to the dataset/visible through the UI

How can we reproduce the bug?

  1. Setup collector and run

model = ChatVertexAI( model_name="gemini-2.0-flash-001", safety_settings=BLOCK_NONE, location=REGION, ).bind(temperature=0)

model.invoke("Hello!")

  1. Add the span to the dataset

Additional information

I think it's related to the way Gemini API return data which does not follow openAI standards

vincentventalon avatar Apr 01 '25 11:04 vincentventalon

Thanks for filing this issue @vincentventalon ! It could be related to multi-part content but we will take a look.

cc @anticorrelator

mikeldking avatar Apr 02 '25 14:04 mikeldking

Hi, @vincentventalon. I'm Dosu, and I'm helping the Arize Phoenix team manage their backlog and am marking this issue as stale.

Issue Summary:

  • You reported that in Phoenix 7.12.2, Gemini model traces are only partially added to datasets, with input/output fields mostly empty except for "role."
  • The issue seems related to Gemini's API response format differing from OpenAI's, possibly involving multi-part content.
  • This occurs on a self-hosted container using Python 3.10 on GCP Cloud Run.
  • A maintainer acknowledged the issue and tagged another team member for further investigation.
  • The issue remains unresolved with no recent updates.

Next Steps:

  • Please let me know if this issue is still relevant with the latest version of Arize Phoenix by commenting here.
  • If I do not hear back within 7 days, this issue will be automatically closed.

Thank you for your understanding and contribution!

dosubot[bot] avatar Aug 21 '25 16:08 dosubot[bot]

Hello, I'm also having this issue. Using Gemini Flash 2.5 Just tried with 1 span and Im not getting input and output filled. Only seeing "--" on the UI

chaos87 avatar Sep 07 '25 08:09 chaos87