NeMo-Guardrails icon indicating copy to clipboard operation
NeMo-Guardrails copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

NeMo-Guardrails breaks Langfuse integration / Runnable config is ignored in LLM call

Open gingters opened this issue 1 year ago • 3 comments

When Langfuse is used for tracing (instead of Langsmith), the usage of NeMo-Guardrails in a Langchain chain completely breaks the tracing functionality.

The reason seems to be, that the langchain runnable is not called with the runnable config, which defines callbacks for langchain. So the LLM runnable that is wrapped in the RunnableRails object is missing the runnable config, and as such the callbacks configured there won't be called and as such the tracing isn't invoked.

gingters avatar Apr 26 '24 14:04 gingters

Hi is there any status update on this please?

dan-robinson-ai avatar Jul 26 '24 14:07 dan-robinson-ai

Not yet. A contribution here would be welcome if anyone can help.

drazvan avatar Jul 26 '24 14:07 drazvan

Hi, any updates on this please?

yskale avatar Oct 22 '24 17:10 yskale