ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

[Question]: metadata in chunk level

Open yangxg opened this issue 10 months ago • 3 comments

Describe your problem

Now that the feature of setting metadata in document level is available, I would further prefer setting metadata in chunk level, which would more helpful for retrieving chunks.

I have tried two alternative way.

The first is the table parsing method in which the columns other than the chunk text column play as the metadata, but it is not as well as expected.

Another is setting the tags to each chunk. It looks useful, but I have to set the tags to each chunk mannually, I don't know if there were more efficient way to set tags to chunks, API would be ideal.

Any suggesion would be appreciated.

yangxg avatar Mar 02 '25 15:03 yangxg

Could you elaberate on the scenario? Then, we could come up with some solutions.

KevinHuSh avatar Mar 03 '25 04:03 KevinHuSh

Hi @yangxg A v0.16.0 feature called tag knowledge base allows you to bulk tag chunks using the LLM. I haven't gotten around to creating a guide for it. Will link my PR to this issue.

writinwaters avatar Mar 06 '25 07:03 writinwaters

Many thanks for all! It is really an amazing product and team.

yangxg avatar Mar 12 '25 13:03 yangxg