KAG icon indicating copy to clipboard operation
KAG copied to clipboard

关于推理速度

Open jhluaa opened this issue 11 months ago • 1 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

Operating system information

Linux

What happened

我成功的执行了项目,有点疑问。 目前使用同样的模型+嵌入; graphrag的推理一般在 10s-20s 问一个问题 KAG 的推理一般>20s 这正常吗,我想问大家推理时长多久。

How to reproduce

z

Are you willing to submit PR?

  • [X] Yes I am willing to submit a PR!

jhluaa avatar Jan 13 '25 08:01 jhluaa

时间太长了。估计要几分钟。不明白为啥?

sooit avatar Jan 15 '25 07:01 sooit

我也是,我测试的时候估摸着一次至少30s朝上。匹配实体的时候显示循环三次没有匹配到相关实体,但是每次都有实体信息列表打印出来,最后也是有正确答案,不知道为啥。

ZHJ19970917 avatar Jan 22 '25 06:01 ZHJ19970917

我也是,我测试的时候估摸着一次至少30s朝上。匹配实体的时候显示循环三次没有匹配到相关实体,但是每次都有实体信息列表打印出来,最后也是有正确答案,不知道为啥。

You can try out our latest version of KAG V0.8, In which, we have improved the management of private domain knowledge base indexing, incorporating multiple foundational index types such as Outline, Summary, KnowledgeUnit, AtomicQuery, Chunk, and Table.

Users can chose the index types that suit their scenarios.

caszkgui avatar Aug 16 '25 00:08 caszkgui