ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

[Bug]: When using the openai compatible model, the model supports and the maximum token is set to 128000, but it is still stuck within 8000 tokens and truncated.

Open stelvetica opened this issue 10 months ago • 3 comments

Is there an existing issue for the same bug?

  • [x] I have checked the existing issues.

RAGFlow workspace code commit ID

how to find it

RAGFlow image version

v0.16.0 full

Other environment information

window

Actual behavior

Image

Image

Expected behavior

No response

Steps to reproduce

RT

Additional information

No response

stelvetica avatar Feb 26 '25 16:02 stelvetica

我也有个差不多的问题:解析知识库文件的时候,如果嵌入模型序列长度是512的,即使分块大小设置远小于512,请求模型时候还是很容易超过512导致解析失败

hpx502766238 avatar Feb 26 '25 16:02 hpx502766238

会不会是api提供方的限制?

zbaos260 avatar Feb 27 '25 02:02 zbaos260

Disable the max token.

KevinHuSh avatar Feb 27 '25 03:02 KevinHuSh