ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

[Question]: Which types of documents are suitable for using the Knowledge Graph chunking method?

Open Match-Yang opened this issue 1 year ago • 1 comments

Describe your problem

I have a technical documentation website about SDK usage.

The documents include feature introduction documents, API documents, concepts and terminology, error codes, etc. Among them, API documents account for about half of the total volume.

Which types of documents are suitable for using the Knowledge Graph chunking method? Because obviously, if all are used with the Knowledge Graph chunking method, it will be very slow and consume a lot of LLM tokens. However, if the API documents, which account for nearly half of the total volume, do not use the Knowledge Graph chunking method, it will be difficult to associate them with the feature documents, leading to "hallucinations" when generating example code in the final answers.

I hope to have some usage suggestions or best practice guidance.

Match-Yang avatar Nov 13 '24 10:11 Match-Yang

I don't think KG is a good choise. Could you make an example why API instructions can't associate with feature documents, and why human being can related them?

KevinHuSh avatar Nov 14 '24 04:11 KevinHuSh