helicone icon indicating copy to clipboard operation
helicone copied to clipboard

[Bug]: Vertex AI (Gemini) requests not showing logs or token/cost metrics in dashboard

Open droid-ash opened this issue 7 months ago • 1 comments

What happened?

I’m using Helicone with Google Cloud’s Vertex AI (Gemini-2.5-pro-preview) provider, but none of my Vertex AI calls are appearing in the dashboard logs – token counts and cost remain at zero. OpenAI (gpt-4o) calls work fine (see green box), but every Gemini request shows success with 0 tokens and $0.00000 cost (see red box).

Screenshots:

Image Image

Steps to Reproduce:

  1. Create or select a Google Cloud project and enable Vertex AI.
  2. Configure Helicone with your Vertex AI credentials (e.g. via environment variables).
  3. Send a simple request to Gemini (e.g. gemini-2.5-pro-preview-03-25)
  4. Open the Helicone dashboard → Requests.

Observed Behavior:

  • Vertex AI (Gemini) requests appear with status “Success”
  • Input Tokens, Output Tokens, Total Tokens all show “0”
  • Cost is always $0.00000
  • No detailed logs or metrics for the call

Expected Behavior:

  • Dashboard should log input/output token counts for Vertex AI calls
  • Estimated cost should reflect actual token usage
  • Behave the same way as it does for the OpenAI provider

Environment:

  1. Helicone version: e.g. v1.2.3
  2. Google Cloud SDK / Vertex AI enabled
  3. Model tested: gemini-2.5-pro-preview-03-…
  4. Helicone integration: environment variables / hosted
  5. Browser + OS: e.g. Chrome 120 on macOS Ventura

droid-ash avatar May 01 '25 07:05 droid-ash

the same case is happening for 4o with me, nothing appears

Image

TechKemon avatar May 28 '25 19:05 TechKemon

closing this since we added support for Vertex and Gemini models. cc @droid-ash

connortbot avatar Jul 15 '25 18:07 connortbot

Thanks @connortbot

droid-ash avatar Jul 29 '25 03:07 droid-ash