Flowise icon indicating copy to clipboard operation
Flowise copied to clipboard

[BUG] - overrideConfig not passed to Langsmith

Open blackge opened this issue 9 months ago • 8 comments

Describe the bug When using overrideConfig to set tags and metadata in LangSmith, it is not passing the data through to langsmith.

To Reproduce Steps to reproduce the behavior:

When calling prediction API, set overrideConfig

overrideConfig: {
      "analytics": {
        "langSmith": {
          "tags": ["DEI"],
          "metadata": {
            "sessionId": sessionId ? sessionId : "123",
          }
        }
      }
    }

Expected behavior Metadata should appear in Langsmith

Screenshots Metadata does not appear.

Screenshot 2024-05-16 at 12 16 27

Setup

  • Installation on Railway
  • Flowise Version 1.6.5
  • OS: [e.g. macOS, Windows, Linux]
  • Browser [e.g. chrome, safari]

Additional context This is possibly a documentation issue and an example is needed. However looking at the code in /packages/src/components/handler.ts the additionalHandlers isn't passing the options into the langSmith trace. Assuming options is what is passed in from the overrideConfig, this would explain why it doesn't get passed through. The same issue applies to the Langfuse call.

blackge avatar May 16 '24 11:05 blackge