ragflow icon indicating copy to clipboard operation
ragflow copied to clipboard

Feature: support when re index will delete the files not in remote

Open Woody-Hu opened this issue 1 month ago • 5 comments

What problem does this PR solve?

https://github.com/infiniflow/ragflow/issues/11460

for sync via time span, it may difficult due to no delete record

Type of change

  • [x] New Feature (non-breaking change which adds functionality)

Woody-Hu avatar Nov 24 '25 01:11 Woody-Hu

Appreciations!

https://github.com/infiniflow/ragflow/blob/e0e1d04da511b027086a6510bff1b18951cccd14/api/db/services/connector_service.py#L70 Re-index will delete all files firstly.

For #11460, it needs to remove deleted file in increamental synchronization, dosen't it?

KevinHuSh avatar Nov 24 '25 02:11 KevinHuSh

Appreciations!

https://github.com/infiniflow/ragflow/blob/e0e1d04da511b027086a6510bff1b18951cccd14/api/db/services/connector_service.py#L70

Re-index will delete all files firstly. For #11460, it needs to remove deleted file in increamental synchronization, dosen't it?

add a work round solution

Woody-Hu avatar Nov 24 '25 05:11 Woody-Hu

@Woody-Hu Hi! I'm the product manager. Really appreciate your contribution. Could you wait for @Furkan-Demir 's response to my question https://github.com/infiniflow/ragflow/issues/11460#issuecomment-3569650212?

ZhenhangTung avatar Nov 24 '25 09:11 ZhenhangTung

@Woody-Hu Hi! I'm the product manager. Really appreciate your contribution. Could you wait for @Furkan-Demir 's response to my question #11460 (comment)?

now I add a os env to control this due to I found it is difficult to find a config name to describe this at front end. We can continue discuss.

Woody-Hu avatar Nov 26 '25 00:11 Woody-Hu

I can design a UI control for this feature, and once it’s ready, you’ll be able to manage it directly from the interface.

ZhenhangTung avatar Nov 27 '25 02:11 ZhenhangTung