phoenix
phoenix copied to clipboard
[BUG]: trace from gemini only partially added to a dataset
Where do you use Phoenix
Container (self-hosted)
What version of Phoenix are you using?
7.12.2
What operating system are you seeing the problem on?
GCP cloud run container
What version of Python are you running Phoenix with?
3.10
What version of Python or Node are you using instrumentation with?
3.10
What instrumentation are you using?
No response
What happened?
When adding a trace to a dataset
Input and output are empty showing only "role".
What did you expect to happen?
The question and LLM answer are also added to the dataset/visible through the UI
How can we reproduce the bug?
- Setup collector and run
model = ChatVertexAI( model_name="gemini-2.0-flash-001", safety_settings=BLOCK_NONE, location=REGION, ).bind(temperature=0)
model.invoke("Hello!")
- Add the span to the dataset
Additional information
I think it's related to the way Gemini API return data which does not follow openAI standards
Thanks for filing this issue @vincentventalon ! It could be related to multi-part content but we will take a look.
cc @anticorrelator
Hi, @vincentventalon. I'm Dosu, and I'm helping the Arize Phoenix team manage their backlog and am marking this issue as stale.
Issue Summary:
- You reported that in Phoenix 7.12.2, Gemini model traces are only partially added to datasets, with input/output fields mostly empty except for "role."
- The issue seems related to Gemini's API response format differing from OpenAI's, possibly involving multi-part content.
- This occurs on a self-hosted container using Python 3.10 on GCP Cloud Run.
- A maintainer acknowledged the issue and tagged another team member for further investigation.
- The issue remains unresolved with no recent updates.
Next Steps:
- Please let me know if this issue is still relevant with the latest version of Arize Phoenix by commenting here.
- If I do not hear back within 7 days, this issue will be automatically closed.
Thank you for your understanding and contribution!
Hello, I'm also having this issue. Using Gemini Flash 2.5 Just tried with 1 span and Im not getting input and output filled. Only seeing "--" on the UI