ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

[Question]: Knowlegde base crashed?

Open Joey233qwq opened this issue 10 months ago • 17 comments

Self Checks

  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (Language Policy).
  • [x] Non-english title submitions will be closed directly ( 非英文标题的提交将会被直接关闭 ) (Language Policy).
  • [x] Please do not modify this template :) and fill in all the required fields.

Describe your problem

I just restart docker then the knowledge base crashed like this:

Image

How can I save the knowledge base?

Joey233qwq avatar Mar 16 '25 03:03 Joey233qwq

And every book appears like above picture, with the exactly same information "{"src_id": "", "tgt_id": "", "description": "", "keywords": [""], "weight": 0.0, "source_id": ["2bebd31400d711f0b03a729d082247bc"]}".

Joey233qwq avatar Mar 16 '25 04:03 Joey233qwq

Version is v0.17.2 slim

Joey233qwq avatar Mar 16 '25 04:03 Joey233qwq

It seems that searching process still works. But the display is crashed.

Image

But every bottom of chunks are closed, even some of them can't be opened manually

Image

Joey233qwq avatar Mar 16 '25 04:03 Joey233qwq

And the knowledge graph disapper:

Image

Joey233qwq avatar Mar 16 '25 11:03 Joey233qwq

@KevinHuSh Sorry to bother, but could you please tell me how to fix this? I have spent a lot on this knowledge base. :-(

Joey233qwq avatar Mar 17 '25 05:03 Joey233qwq

I did not quite follow what's the situation here?

KevinHuSh avatar Mar 17 '25 06:03 KevinHuSh

I did not quite follow what's the situation here?

As you can see here, when I preview the parsed document, every chunk displays like this:

Image

When I use retrieval testing, it show like this:

Image

Joey233qwq avatar Mar 17 '25 06:03 Joey233qwq

Besides, previously created knowledge graph disappered.

Joey233qwq avatar Mar 17 '25 06:03 Joey233qwq

What did you do?

KevinHuSh avatar Mar 17 '25 06:03 KevinHuSh

What did you do?

I asked this before in #5953. Last time, I upgraded ragflow. But this time, I simply restart docker for a couple of times.

Joey233qwq avatar Mar 17 '25 06:03 Joey233qwq

What did you do?

Besides restarting, all I did was generating knowledge graph.

Joey233qwq avatar Mar 17 '25 06:03 Joey233qwq

My case is similar, the knowledge graph generated in 0.17.1 disappeared in 0.17.2 (no 'Knowledge Graph' section on the sidebar shown as the screenshot above). I could still retrieve the knowledge graph content as well as chunks during retrieval testing.

Astraeus-Q avatar Mar 17 '25 06:03 Astraeus-Q

My case is similar, the knowledge graph generated in 0.17.1 disappeared in 0.17.2 (no 'Knowledge Graph' section on the sidebar shown as the screenshot above). I could still retrieve the knowledge graph content as well as chunks during retrieval testing.

I even can't retrieve KG. There's error report:"KeyError('from_entity_kwd')"

Joey233qwq avatar Mar 17 '25 06:03 Joey233qwq

What did you do?

I asked this before in #5953. Last time, I upgraded ragflow. But this time, I simply restart docker for a couple of times.

Which version did you upgrade from?

KevinHuSh avatar Mar 17 '25 06:03 KevinHuSh

What did you do?

I asked this before in #5953. Last time, I upgraded ragflow. But this time, I simply restart docker for a couple of times.

Which version did you upgrade from?

Last time, my version is v0.16 to v0.17.0-90-g47e244ee slim. This time, I didn't upgrade, constantly v0.17.2 slim.

Joey233qwq avatar Mar 17 '25 06:03 Joey233qwq

Sorry, I don't have better solutions rather than re-do parsing.

KevinHuSh avatar Mar 17 '25 06:03 KevinHuSh

Sorry, I don't have better solutions rather than re-do parsing.

Alright. Thanks for your reply.

Joey233qwq avatar Mar 17 '25 06:03 Joey233qwq

Sorry, I don't have better solutions rather than re-do parsing.

@KevinHuSh Sorry to bother. This time I re-do parsing, and when one of the knowledge graph process finished, the knowledge base crashed again. This time I only re-do the parsing process, no restarting or upgrading:

Image

Joey233qwq avatar Mar 18 '25 11:03 Joey233qwq

As you can see from my last knowledge graph extraction log here, the "source_id" are exactly the same with the last parsing document(d2a3a8c2038d11f083493a0474505c92):

开始于: Tue, 18 Mar 2025 11:35:36 GMT 持续时间: 20841.40 s 进度: 11:37:35 Task has been received. 11:37:49 Page(1~100000001): Start to parse. 11:37:51 Page(1~100000001): Finish parsing. 11:38:06 Page(1~100000001): Generate 380 chunks 11:39:04 Page(1~100000001): Embedding chunks (57.73s) 11:39:54 Page(1~100000001): Indexing done (49.91s). Task done (138.21s) 16:04:06 Entities extraction of chunk 366 354/380 done, 24 nodes, 0 edges, 14765 tokens. 16:04:22 Entities extraction of chunk 370 355/380 done, 12 nodes, 11 edges, 9878 tokens. 16:04:37 Entities extraction of chunk 369 356/380 done, 22 nodes, 22 edges, 12557 tokens. 16:04:49 Entities extraction of chunk 364 357/380 done, 17 nodes, 11 edges, 10310 tokens. 16:04:50 Entities extraction of chunk 363 358/380 done, 18 nodes, 18 edges, 12164 tokens. 16:05:06 Entities extraction of chunk 371 359/380 done, 22 nodes, 13 edges, 8713 tokens. 16:05:13 Entities extraction of chunk 368 360/380 done, 11 nodes, 0 edges, 14579 tokens. 16:05:18 Entities extraction of chunk 373 361/380 done, 30 nodes, 21 edges, 13200 tokens. 16:05:23 Entities extraction of chunk 379 362/380 done, 13 nodes, 9 edges, 7130 tokens. 16:05:30 Entities extraction of chunk 374 363/380 done, 22 nodes, 6 edges, 9424 tokens. 16:06:30 Entities extraction of chunk 375 364/380 done, 46 nodes, 0 edges, 15321 tokens. 16:06:36 Entities extraction of chunk 372 365/380 done, 1 nodes, 0 edges, 12495 tokens. 16:06:41 Entities extraction of chunk 361 366/380 done, 13 nodes, 0 edges, 16379 tokens. 16:07:24 Entities extraction of chunk 376 367/380 done, 1 nodes, 1 edges, 15396 tokens. 16:08:06 Entities extraction of chunk 378 368/380 done, 43 nodes, 54 edges, 26132 tokens. 16:08:42 Entities extraction of chunk 25 369/380 done, 10 nodes, 16 edges, 24649 tokens. 16:31:43 Entities extraction of chunk 69 370/380 done, 15 nodes, 26 edges, 40062 tokens. 16:31:43 Entities extraction of chunk 34 371/380 done, 1 nodes, 0 edges, 43362 tokens. 16:31:43 Entities extraction of chunk 3 372/380 done, 18 nodes, 10 edges, 38795 tokens. 16:31:44 Entities extraction of chunk 95 373/380 done, 2 nodes, 0 edges, 27462 tokens. 16:31:44 Entities extraction of chunk 112 374/380 done, 13 nodes, 25 edges, 40509 tokens. 16:32:09 Entities extraction of chunk 209 375/380 done, 13 nodes, 2 edges, 10632 tokens. 16:33:49 Entities extraction of chunk 144 376/380 done, 23 nodes, 20 edges, 39695 tokens. 16:33:55 Entities extraction of chunk 166 377/380 done, 11 nodes, 17 edges, 39696 tokens. 16:34:04 Entities extraction of chunk 332 378/380 done, 42 nodes, 43 edges, 40252 tokens. 16:34:15 Entities extraction of chunk 301 379/380 done, 7 nodes, 33 edges, 40689 tokens. 16:35:48 Entities extraction of chunk 377 380/380 done, 52 nodes, 23 edges, 41997 tokens. 16:35:49 Entities and relationships extraction done, 4795 nodes, 4057 edges, 4999382 tokens, 17749.23s. 16:58:14 Entities merging done, 1345.79s. 17:22:12 Relationships merging done, 1437.93s. 17:22:13 generated subgraph for doc d2a3a8c2038d11f083493a0474505c92 in 20533.76 seconds. 17:22:56 merging subgraph for doc d2a3a8c2038d11f083493a0474505c92 into the global graph done in 42.96 seconds. 17:22:56 GraphRAG for doc d2a3a8c2038d11f083493a0474505c92 done in 20577.78 seconds. 17:22:56 Knowledge Graph done (20578.00s)

Joey233qwq avatar Mar 18 '25 11:03 Joey233qwq