Add support for Gemini API

[masterbatcoderman10]

I'm creating this issue to request support on the Gemini API, currently, tracked calls for the Gemini API do not show any information on the token/cost breakdown, therefore, please enable support as you have for Mistral, and Anthropic.

[jwlee64]

Hi, I am one of the developers for weave, we can add cost support for gemini apis. Could you send the link to the project your are working in so I can ensure that the eventual fix works for your project? I will ticket and add to backlog.

[masterbatcoderman10]

I am grateful for your commitment and your support, here is the link to my project.

https://wandb.ai/lighthouseai/QA-monitoring/weave/traces

Thanks

On Wed, Jul 3, 2024 at 8:11 PM Josiah Lee @.***> wrote:

Hi, I am one of the developer for weave, I can add cost support for gemini apis. Could you send the link to the project your are working in so I can ensure that my fix works for your project?

— Reply to this email directly, view it on GitHub https://github.com/wandb/weave/issues/1879#issuecomment-2206722645, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKJXGPKZ7PO25EU7RRU7KWTZKQPCVAVCNFSM6AAAAABKJJE5OCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMBWG4ZDENRUGU . You are receiving this because you authored the thread.Message ID: @.***>

[morganmcg1]

@masterbatcoderman10 just to let you know that @soumik12345 is working on a PR at the moment to add support for Google AI Studio

https://github.com/wandb/weave/pull/2078

[tcapelle]

The integration is merged now; I think token usage should be there: https://github.com/wandb/weave/pull/2399

[masterbatcoderman10]

Thanks for the notification.

On Fri, 18 Oct 2024 at 2:13 PM Thomas Capelle @.***> wrote:

The integration is merged now; I think token usage should be there: #2399 https://github.com/wandb/weave/pull/2399

— Reply to this email directly, view it on GitHub https://github.com/wandb/weave/issues/1879#issuecomment-2422083322, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKJXGPMXTQQSN7UFLDAJ26LZ4DNMHAVCNFSM6AAAAABKJJE5OCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIMRSGA4DGMZSGI . You are receiving this because you were mentioned.Message ID: @.***>

[ramon-prieto]

@tcapelle this is still not working if using the vertexai library, which is the preferred method if accessing Gemini via GCP. Any chance it can be implemented?

[soumik12345]

@ramon-prieto Thanks for raising the issue with the vertexai integration. I have raised a PR https://github.com/wandb/weave/pull/3110 to fix it.