dify
dify copied to clipboard
【bug】prompt is too long
Self Checks
- [X] This is only for bug report, if you would like to ask a question, please head to Discussions.
- [X] I have searched for existing issues search for existing issues, including closed ones.
- [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
- [X] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
- [X] Please do not modify this template :) and fill in all the required fields.
Dify version
0.6.12-fix1
Cloud or Self Hosted
Self Hosted (Docker)
Steps to reproduce
when i use claude3.5-sonnet(support 200k) to tag a photo about 1.5MB as agent , dify said prompt tokens are 1500000+ tokens much bigger than 200k; when i debug api module, i found than prompt tokens are caculated by the photo‘s bytes
✔️ Expected Behavior
prompt tokens should be calculated correctly.
❌ Actual Behavior
No response