agentops icon indicating copy to clipboard operation
agentops copied to clipboard

Add DSPY instrumentor

Open areibman opened this issue 1 year ago • 4 comments

🚀 Feature Request

💡 Got a brilliant idea? Using either OpenInference or OpenLLMetry, add an instrumented for DSPY. This is the first of several test features we'll use to determine which is the best instrumentation library.

areibman avatar Feb 27 '24 22:02 areibman

This looks like a very cool idea, can I work on it?

Dsantra92 avatar Apr 06 '24 06:04 Dsantra92

This looks like a very cool idea, can I work on it?

Sure, feel free to take a stab. Are you using DSPY on the regular? Would love to know why this in particular seems interesting.

One option is to look at what other folks are doing. We saw OpenInference built a DSPY adapter already. . The idea would be to copy that pattern and either a) copy + adjust the code to create AgentOps events or b) create our own open telemetry collector and just outfit AgentOps to send data to that service.

It's really more of an experimental thing for us.

areibman avatar Apr 06 '24 06:04 areibman

I see this on Langwatch: https://docs.langwatch.ai/dspy-visualization/quickstart

therealtimex avatar Aug 07 '24 00:08 therealtimex

I see this on Langwatch: https://docs.langwatch.ai/dspy-visualization/quickstart

Could probably fork the integration approach they used

areibman avatar Aug 07 '24 00:08 areibman