ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

[Question]: The problem of slow index building

Open 3414391918 opened this issue 10 months ago • 1 comments

Describe your problem

Image

As shown in the figure, what I understand is that a large amount of entity and relationship information needs to be inserted into es during the construction of the graph index. It takes about ten seconds between the two es requests. I think this is the reason why the index construction is slow. After I optimized the extraction and merging process of entities and relationships, it is quite fast and can be completed in less than ten minutes. But the process of this es operation lasted 3-4 hours. If there are thousands of entities and relationships in my document, and the time between 2 es requests is about a few seconds, that can also explain why this process lasts so long. If my understanding is correct, I would like to know how to optimize this problem. After all, this process takes too much time.

3414391918 avatar Mar 01 '25 10:03 3414391918

This ten seconds might speed on comunications with LLM.

KevinHuSh avatar Mar 03 '25 04:03 KevinHuSh