dify icon indicating copy to clipboard operation
dify copied to clipboard

Vertex AI Models cannot read document content in workflow/chatflow

Open fdb02983rhy opened this issue 9 months ago • 1 comments

Self Checks

  • [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [x] Please do not modify this template :) and fill in all the required fields.

Dify version

1.0.0

Cloud or Self Hosted

Cloud

Steps to reproduce

Gemini from Google AI Studio, Workflow ✅

Image

Gemini, Anthropic Claude from Vertex AI, Workflow ❌

Image

Gemini from Vertex AI, Chatbot ✅

Image

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

fdb02983rhy avatar Mar 02 '25 13:03 fdb02983rhy

The issue you're experiencing with Vertex AI models not reading document content in workflows might be related to known limitations with the Gemini 2.0 Flash 001 model. Specifically, this model does not support JSON Schema functionality in the Vertex provider, which can lead to errors when using agent tools or enabling JSON Schema settings [1].

To address this, ensure that both the JSON Schema setting and agent tools are disabled when using the Gemini 2.0 Flash 001 model in your workflow. This might help resolve the issue with processing document content.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

dosubot[bot] avatar Mar 02 '25 14:03 dosubot[bot]