Execution Observability with OpenTelemetry

[nirga]

Summary OpenTelemetry is a CNCF standard for cloud observability. It instruments HTTP calls, DB calls, etc as traces. Together with OpenLLMetry, which provides instrumentations for LLM providers like OpenA, vector DBs like Chroma and LLamaIndex - it gives a great way to view and debug agent exceutions.

It's natively supported by all major observability platforms like Datadog, Honeycomb, New Relic and others, so if we install the SDK in the repo it allows users to see and debug executions of OpenDevin.

Motivation

Debug and see executions of OpenDevin, including LLM calls, vector DB calls, HTTP calls, and others.

Technical Design

We can offer an option to initialize an SDK, like the one provided by OpenLLMetry so if the user enables it they can view execution traces.

Alternatives to Consider

None

Additional context