quarkus-langchain4j icon indicating copy to clipboard operation
quarkus-langchain4j copied to clipboard

Published 20 hours ago • verified publisher icon quarkiverse

Observability for RAG

Open geoand opened this issue 1 year ago • 4 comments

This article makes a very good case for adding observability to RAG.

We should probably head the advice and add metrics and tracing to our RAG approach

geoand avatar Mar 01 '24 13:03 geoand

@langchain4j FYI

geoand avatar Mar 01 '24 13:03 geoand

@geoand are there any plans for this? What metrics should be observed?

On galileo.ai site, I found these articles related to observability/metrics:

  • https://docs.galileo.ai/galileo/gen-ai-studio-products/galileo-observe/how-to/choosing-your-guardrail-metrics
  • https://docs.galileo.ai/galileo/gen-ai-studio-products/galileo-evaluate/how-to/choose-your-guardrail-metrics

rsvoboda avatar Jan 17 '25 14:01 rsvoboda

Yeah, we should add something at some point

geoand avatar Jan 17 '25 14:01 geoand

@langchain4j is there anything in upstream LangChain4j around this topic?

geoand avatar Jan 20 '25 09:01 geoand