langchainjs icon indicating copy to clipboard operation
langchainjs copied to clipboard

Interest in supporting DataDog LLMObs non-beta API endpoint?

Open mejackreed opened this issue 1 year ago • 1 comments

Checked other resources

  • [X] I added a very descriptive title to this issue.
  • [X] I searched the LangChain.js documentation with the integrated search.
  • [X] I used the GitHub search to find a similar question and didn't find it.
  • [X] I am sure that this is a bug in LangChain.js rather than my code.
  • [X] The bug is not resolved by updating to the latest stable version of LangChain (or the specific integration package).

Example Code

  const output = await myChain.invoke(
    {
      input: '',
    },
    {
      callbacks: [
        new DatadogLLMObsTracer({
          mlApp: 'HiThere',
          service: 'foo',
          env: 'prod',
        }),
      ],
    },
  );

Error Message and Stack Trace (if applicable)

No response

Description

Currently the langchain-community DataDog handler has some errors using the https://docs.datadoghq.com/llm_observability/api/?tab=model

Specifically, Langchain's MessageContent serialization is incompatible with the upstream Message content: string type.

Are you open to a friendly pull request to add this compatibility?

System Info

not needed, api incompatibility

mejackreed avatar Jul 20 '24 14:07 mejackreed

Hey is this still an issue or did you find a workaround? I can look into it if it's still open :)

kritgrover avatar Sep 30 '24 04:09 kritgrover

Hi, @mejackreed. I'm Dosu, and I'm helping the LangChain JS team manage their backlog. I'm marking this issue as stale.

Issue Summary

  • Compatibility issue between LangChain.js and DataDog LLMObs non-beta API endpoint.
  • Problem relates to message content serialization.
  • You considered submitting a pull request for resolution.
  • @kritgrover showed interest in investigating further and asked if the issue remains unresolved.

Next Steps

  • Could you confirm if this issue is still relevant with the latest version of LangChain JS? If so, please comment to keep the discussion open.
  • If there is no further activity, the issue will be automatically closed in 7 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Dec 30 '24 16:12 dosubot[bot]