[BUG]The old content in the [document storage[ was not successfully cleared.
In the [document storage], I have successfully stored documents "file1, file2, file3" into the Postgres database via Flowise. Afterwards, I deleted "file1, file2, file3" and loaded "file4" in the [document storage] of Flowise, with the upsert chunks operation completing successfully. However, I logging into Postgres to check, it was found that the data of the old three files were still there. when I use [chatflows] for conversation, its responses also cite content from file1, file2, and file3.
I expected: when I delete f"file1, file2, file3", these files should also be deleted from Postgres, and chatflows should not reference the data that has been deleted during conversation.
Flowise Version:2.2.6-hotfix.1 Postgres version:17 OS:Centos7
This happens to me too... noticed in 2.2.4 and 2.2.7-patch.1.
Before changing documents on loaders, I always have to go to the database to clean up old content, despite the "added/updated/ignored/deleted" screen showing what I really want to happen.
It's easy to spot this bug by going to the "Retrieval Query" screen. After you query something, you can see repeated chunks on the right.
I hope Mr. @HenryHengZJ could help us!
Thanks! 🙏
Hi! Any news on this?
Thanks!! :)
The problem still hasn't been solved
I think this is duplicate of #3570, there is a great explanation why this is happening.
Hi, I also ran into this. Sadly this means Postgresql is pretty much unucable at this time. :(
Fix: https://github.com/FlowiseAI/Flowise/pull/5536