Flowise icon indicating copy to clipboard operation
Flowise copied to clipboard

[BUG] - [inputText] is not permitted when upgrading to Claude 3 and cohere models

Open haimco50 opened this issue 1 year ago • 4 comments

Upgrading bedrock model from claude 2 to claude 3 and embedding model from amazon.titan-embed-text-v1 to cohere.embed-multilingual-v3 and started getting the bellow errror when tryting to upsert embeddings.

image

issue seeems to be related to this issue : https://github.com/langchain-ai/langchain/pull/18630

and may need upgradiung the conversation retrieval QA chain node to support this but not sure...

image

To Reproduce trying to upserts / chat after upgrading will cause a validation error to apear.

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Flow If applicable, add exported flow in order to help replicating the problem.

Setup

  • Installation [e.g. docker, npx flowise start, pnpm start]
  • Flowise Version [e.g. 1.2.11]
  • OS: [e.g. macOS, Windows, Linux]
  • Browser [e.g. chrome, safari]

Additional context Add any other context about the problem here.

haimco50 avatar Mar 28 '24 19:03 haimco50

I changed the embedding model to amazon.titan-embed-g1-text-02 (as it's shown in my flow) so it can work - the issue is happenning with cohere.embed-multilingual-v3 model

haimco50 avatar Mar 28 '24 19:03 haimco50

I changed the embedding model to amazon.titan-embed-g1-text-02 (as it's shown in my flow) so it can work - the issue is happenning with cohere.embed-multilingual-v3 model

thanks for pinning down the issue, can u try to see if upgrading langchain community package solves the issue

HenryHengZJ avatar Mar 30 '24 13:03 HenryHengZJ

Already did so, this is the first thing I did - it didn't work - IMHO the issue seems to be with the Flowise AWS BedrockChat componnent (something with the prompt setup) - see this thread issue - https://github.com/langchain-ai/langchain/issues/18514

haimco50 avatar Mar 30 '24 13:03 haimco50

found out the issue, because we are using body format that is only compatible with amazon titan embeddings - https://github.com/FlowiseAI/Flowise/blob/main/packages/components/nodes/embeddings/AWSBedrockEmbedding/AWSBedrockEmbedding.ts#L150

cohere embeddings require another type of body format

HenryHengZJ avatar Apr 03 '24 11:04 HenryHengZJ