Mintplex-Labs
[FEAT]: Auto-Add ALL Docs in a Given Folder
What would you like to see?
I would like to have an option that allows AnythingLLM to auto-add all documents from a specified folder and continuously watch the folder for new documents to be added automatically. This would work very similarly to "Automatic document sync" (experimental feature) but for the whole designated folder. BTW, gpt4all already has this & it works great!
The reason I'm asking for this is that I'm creating new work almost daily & I want my LLM to be up-to-date & responsive to my current corpus of work.
I see that #1873 was closed 9 months ago, with others asking for the exact same thing. PLEASE reconsider. :|
If you are using the docker version, then you can use this: https://github.com/MrMarans/AnythingLLM_File-Manager Thats what i coded myself. Its tested for windows file paths. It uploads the files to anythingLLM by its own, detects changes, creates/deletes workspaces based on folders and such. See the readme. In a few small updates im going to ask for a mention in anythingLLMs "External Apps & Integrations" part of the readme.
I am currently using the Docker version of AnythingLLM and attempting to integrate it with AnythingLLM_File-Manager, but I've encountered the issue below
If you are using the docker version, then you can use this: https://github.com/MrMarans/AnythingLLM_File-Manager Thats what i coded myself. Its tested for windows file paths. It uploads the files to anythingLLM by its own, detects changes, creates/deletes workspaces based on folders and such. See the readme. In a few small updates im going to ask for a mention in anythingLLMs "External Apps & Integrations" part of the readme.
First off, thanks for using that. I would love to help you, but
- I need a bit more context. It seems you wanted to use the REST API to request an update? I would need to have the full address you wanted to call (you can hide the IP/Port if you want). Please be a bit more verbose for me to investigate your issue. Usually its the /update_files/update/ endpoint you need to call. So please try to open: http://localhost:8000/update_files/update/ Then press the "POST" Button and it should work. Since my programm currently is kind of still in beta, there are a few things missing yet.
If you are have USE_CRON=true in the .env, then you dont need to do anything but wait for 2 minutes (or whatever you set the cron timer to)
- Please create a Issue in my Repository. This thread is an Issue for anythingLLM not having such a feature by its own. Your problem is an issue for my app. I think the people of mintplex would be happy to have their issue threads be more about AnythingLLM itself and not external Apps like mine.
Thank you for saying that @MrMarans - I appreciate you considering my notifications log haha
This feature - monitoring an imported/designated folder and automatically importing new documents - would be immensely useful for me. I collect documents on various topics and separate them into different folders. Being able to assign one (or more) of those folders to a workspace and have it automatically monitored and new documents imported would be a great automation step. Currently using the Desktop app on MacOS.
