LLM node receives multiple base64-encoded images

[wow-ww]

Self Checks

• [X] I have searched for existing issues search for existing issues, including closed ones.
• [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
• [X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

I used HTTP node to obtain multiple images (encoded in base64). I want to pass these base64-encoded images to LLM node for LLM to recognize.

2. Additional context or comments

No response

3. Can you help us with this feature?

• [ ] I am interested in contributing to this feature.

[dosubot[bot]]

Hi, @wow-ww. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

• You are experiencing difficulties passing multiple base64-encoded images from an HTTP node to an LLM node.
• You are seeking a solution or feature to enable effective handling of these images by the LLM node.
• No further comments or developments have been made on this issue.

Next Steps:

• Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here.
• If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

[wow-ww]

Hi, @wow-ww. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

• You are experiencing difficulties passing multiple base64-encoded images from an HTTP node to an LLM node.
• You are seeking a solution or feature to enable effective handling of these images by the LLM node.
• No further comments or developments have been made on this issue.

Next Steps:

• Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here.
• If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

this issue is still relevant to the latest version of the Dify repository.@dosubot

[dosubot[bot]]

@takatost, the user @wow-ww has confirmed that this issue regarding difficulties passing multiple base64-encoded images from an HTTP node to an LLM node is still relevant. Could you please assist them with this?

[xbpeng121]

I also need this feature that "llm node" can accept base64-image as vision content. not only from "HTTP node", but also other nodes, for example "start node".

The scenario is that: I have a 3rd-party system to call workflow service api, there are two ways to pass a image, one-upload it to dify，two-give a remote-url(dify will donwload it) but in High QPS system, it will improve efficiency if dify just pass the variables(base64)to "llm node" ​Instead of​ store it as a file and reread it encode to base64 when call "llm node".

[dosubot[bot]]

Hi, @wow-ww. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

• You reported difficulties in passing multiple base64-encoded images from an HTTP node to an LLM node.
• You confirmed the issue is still relevant to the latest version of the Dify repository.
• @xbpeng121 highlighted the need for efficiency improvements by allowing direct variable passing of base64 images.
• Assistance was requested from @takatost to address the issue, but it remains unresolved.

Next Steps:

• Please confirm if this issue is still relevant to the latest version of the Dify repository by commenting here.
• If no further updates are provided, the issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!