openllmetry icon indicating copy to clipboard operation
openllmetry copied to clipboard

🚀 Feature: Support runpod.ai

Open nirga opened this issue 1 year ago • 3 comments
trafficstars

Which component is this feature for?

All Packages

🔖 Feature description

Add support for instrumenting calls to runpod.ai

🎤 Why is this feature needed ?

Complete our coverage of LLM use cases.

✌️ How do you aim to achieve this?

Similar to the Replicate instrumentation

🔄️ Additional Information

No response

👀 Have you spent some time to check if this feature request has been raised before?

  • [X] I checked and didn't find similar issue

Are you willing to submit PR?

None

nirga avatar Apr 11 '24 17:04 nirga

Hey @nirga , Can i pick this up ? I am first time contributor , if you can help me with some context it would be really helpful

arjunbhut avatar May 01 '24 13:05 arjunbhut

Hey @arjunbhut welcome! Sure. It's building an instrumentation for runpod.ai SDK, similar to ones we have for OpenAI SDK or Anthropic. You can start by looking at their docs and creating a small app that calls them and get the result. Then, you can copy one of the existing instrumentations we have here and modify it to support the APIs you called in the sample app. Join our slack and ping me there if you need more help - https://traceloop.com/slack

nirga avatar May 01 '24 13:05 nirga

Hey @arjunbhut, are you still working on this?

Benedikt-Wolf avatar Jun 25 '24 13:06 Benedikt-Wolf