大大大何塞
大大大何塞
[@dosu](https://go.dosu.dev/dosubot)The default value is 512, why are some of the chunks generated more than 1000, and what criteria is chunk_token_num set to in ragflow?
This I know, in the text parser I changed the separator to use the special separator added during document preprocessing, and also changed the desired chunk size. But the final...
我知道这一点，在文本解析器中，我把分隔符改成了文档预处理时添加的特殊分隔符，并且还修改了所需的块大小。但最终渲染结果只满足了分隔符的要求，并没有达到所需的固定块大小。[@dosu](https://go.dosu.dev/dosubot)