helicone
helicone copied to clipboard
[Bug]: Vertex AI (Gemini) requests not showing logs or token/cost metrics in dashboard
What happened?
I’m using Helicone with Google Cloud’s Vertex AI (Gemini-2.5-pro-preview) provider, but none of my Vertex AI calls are appearing in the dashboard logs – token counts and cost remain at zero. OpenAI (gpt-4o) calls work fine (see green box), but every Gemini request shows success with 0 tokens and $0.00000 cost (see red box).
Screenshots:
Steps to Reproduce:
- Create or select a Google Cloud project and enable Vertex AI.
- Configure Helicone with your Vertex AI credentials (e.g. via environment variables).
- Send a simple request to Gemini (e.g. gemini-2.5-pro-preview-03-25)
- Open the Helicone dashboard → Requests.
Observed Behavior:
- Vertex AI (Gemini) requests appear with status “Success”
- Input Tokens, Output Tokens, Total Tokens all show “0”
- Cost is always $0.00000
- No detailed logs or metrics for the call
Expected Behavior:
- Dashboard should log input/output token counts for Vertex AI calls
- Estimated cost should reflect actual token usage
- Behave the same way as it does for the OpenAI provider
Environment:
- Helicone version: e.g. v1.2.3
- Google Cloud SDK / Vertex AI enabled
- Model tested: gemini-2.5-pro-preview-03-…
- Helicone integration: environment variables / hosted
- Browser + OS: e.g. Chrome 120 on macOS Ventura
the same case is happening for 4o with me, nothing appears
closing this since we added support for Vertex and Gemini models. cc @droid-ash
Thanks @connortbot