Add/delete documents to/from existing vector store

[manikotaru]

Is there a way to update the index files (.pkl and .faiss) with new documents (they can be put in a separate folder) rather than starting the ingest.py over with all the files?

[jaredbradley243]

@dartpain Is this something that can be done? If so, I'll start reading exploring how to implement it.

[gd1m3y]

I think appending to FAISS index is simple enough but the major challenge is in deletion i think since each chunk or text piece has its own ID so makes it a bit more challenging but i think it could be done. for more reference https://github.com/hwchase17/langchain/blob/master/langchain/vectorstores/faiss.py

[shivanandmn]

hi @dartpain, I would like to work on this. i want to use this : https://github.com/langchain-ai/langchain/blob/683f4a93b9b08f7543ce43aae9f277b670e8fb1c/libs/langchain/langchain/vectorstores/faiss.py#L479 to delete. any comments?

[dartpain]

Please try, think it can be beneficial. Oncle we have settings up and running in our app, the will be a vectorstore menu with those extra actions