opik icon indicating copy to clipboard operation
opik copied to clipboard

[FR]: Add Bedrock provider for cost tracking

Open Steinkreis opened this issue 7 months ago • 4 comments

Proposal summary

Currently only following providers are supported for cost tracking as defined in the LLMProvider enum:

  • Google Vertex
  • Google AI
  • Anthropic
  • OpenAI

Given that Bedrock has seen widespread adoption, would you consider adding support for it as well?

Motivation

No response

Steinkreis avatar Apr 13 '25 15:04 Steinkreis

Thanks @Steinkreis – we're going to look into prioritizing it, I'll let you know the next steps!

Currently, the best way to get that done is using the manual tracking option: https://www.comet.com/docs/opik/tracing/cost_tracking#manually-setting-span-costs

The caveat there is it doesn't work well with integrations at the moment.

robertlacok avatar Apr 14 '25 09:04 robertlacok

/bounty 50

vincentkoc avatar May 23 '25 09:05 vincentkoc

💎 $50 bounty • Comet

Steps to solve:

  1. Read Contributing Docs: See contributing guide and read on how to setup Opik and contribute to various parts of the code base.
  2. Start working: Comment /attempt #1836 with your implementation plan
  3. Submit work: Create a pull request including /claim #1836 in the PR body to claim the bounty
  4. Review: Team will review PR and any clarifying questions and if successful changes will be merged
  5. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

❗ Important guidelines:

  • Do NOT start multiple bounties
  • To claim a bounty, you need to provide a short demo video of your changes in your pull request
  • If anything is unclear, ask for clarification before starting as this will help avoid potential rework
  • Low quality AI PRs will not receive review and will be closed
  • Please ask to be assigned before attempting to work on the bounty

Thank you for contributing to Comet!

Attempt Started (UTC) Solution Actions
🟢 @vladimirrotariu Jul 29, 2025, 04:45:24 AM #2843 Reward
🟢 @dhvll May 29, 2025, 06:11:24 PM #2316 Reward

algora-pbc[bot] avatar May 23 '25 09:05 algora-pbc[bot]

/attempt #1830

dhvll avatar May 29 '25 18:05 dhvll

I would pick this up. @vincentkoc can you assign it to me.

lucifertrj avatar Jun 12 '25 21:06 lucifertrj

@lucifertrj please proceed

vincentkoc avatar Jun 17 '25 12:06 vincentkoc

/attempt #1836

vladimirrotariu avatar Jul 29 '25 04:07 vladimirrotariu

Hi @Steinkreis

Thank you for raising this issue and for your interest in this feature. We wanted to let you know that it has now been implemented internally, so we're closing this issue. This has been fully released and deployed and it's available from Opik 1.8.16 onward.

We appreciate your feedback and support. If you have any further questions or suggestions, please feel free to reach out!

andrescrz avatar Aug 06 '25 10:08 andrescrz

Hi @vincentkoc and @lucifertrj , does this mean we can use Amazon Bedrock as AI Provider or in Playground? I'm a new user to Opik and didn't see the same in the latest version. Thanks

AbhiPawar5 avatar Sep 25 '25 08:09 AbhiPawar5