haystack-integrations icon indicating copy to clipboard operation
haystack-integrations copied to clipboard

Add OpenLIT to Haystack Integrations

Open patcher9 opened this issue 9 months ago • 2 comments

How OpenLIT works with Haystack?

OpenLIT basically wraps around OpenAI, Anthropic etc functions and configures OpenTelemetry tracing and metrics for it. In the Haystack pipelines whenever the user runs a pipeline(Since Haystack also uses the same LLM functions), We are automatically able to wrap the pipeline (without needing to create any additional instrumentation for Haystack).

We did add instrumentation just for Document loaders as the rest of the pipeline can directly be tracked for reasons mentioned above.

patcher9 avatar May 22 '24 10:05 patcher9