Mintplex-Labs
[BUG]: Can’t import a folder of docs containing other folders.
How are you running AnythingLLM?
Docker (local)
What happened?
Can’t upload a whole folder of documents. The folder contains other folders that contain documents.
For some reason, the file selector won’t let me select a whole folder either. Can only seem to upload single documents, or multiple single documents.
Also having a problem with drag and drop. Nothing happens. Nothing happens when dropping folders or files. It just doesn’t work.
Importing a whole folder at once is kind of crucial for usability.
It’d also be nice to be able to REPLACE documents easily. That also makes it easy to use. If it makes the user feel LESS FRAGMENTED, then it is providing value.
Are there known steps to reproduce?
On Ubuntu.
Click open and nothing happens.
Nothing happens (drop folder).
Nothing happens (drop file).
When you click on the file uploader, you can only select files. this is intentional and expected Dragging and dropping files/folders does appear to work and I am unable to reproduce this bug at this time.
Yeah it’s not working here on the drag drop. Just using Firefox and whatever the ubuntu stock file app is.
Also the git repo feature doesn’t fetch files from sub folders.
On Sat, May 11, 2024 at 11:16 PM Timothy Carambat @.***> wrote:
When you click on the file uploader, you can only select files. this is intentional and expected Dragging and dropping files/folders does appear to work and I am unable to reproduce this bug at this time.
— Reply to this email directly, view it on GitHub https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106102507, or unsubscribe https://github.com/notifications/unsubscribe-auth/AF632FNOJEHO4KBVYDLUGBLZB3NKJAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEYDENJQG4 . You are receiving this because you authored the thread.Message ID: @.***>
If it is possible to drag drop folders (it’s still not for me…), then what is the purpose of blocking that action when selecting files? Seems a little inconsistent.
One BIG thing that is missing is the ability to bulk remove vector embeddings. Like, if you change your embedder, you have to swap things out. It isn’t automatically done, which is fine. But, really asking somebody to click this little undo icon 869 times to get rid of 869 files? That’s asking a lot of people.
Also getting a lot of page unresponsive error when having that many embeddings :/
Yeah but still a pain point when you have to swap out embeddings en masse, but maybe not all of them.
I’d really like to see a way to have data sources that could have documents or URL’s attached, and then you could refresh those by re-embedding them. It’s like a reusable Refreshable thing instead of a one shot.
Right now it’s kind of in between those two and feels a bit clunky. Don’t get me wrong. It works after things are embedded, and can still get value from it. That’s more than can be said about Lang Chain.
On Sun, May 12, 2024 at 1:51 AM frost19k @.***> wrote:
@atljoseph https://github.com/atljoseph There a button to reset the database in the workspace settings
— Reply to this email directly, view it on GitHub https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106129387, or unsubscribe https://github.com/notifications/unsubscribe-auth/AF632FPVBT3RWZ4PITFIRLTZB37MVAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEZDSMZYG4 . You are receiving this because you were mentioned.Message ID: @.***>
Like for a confluence page. That’s cool to do. But that confluence page is gonna change over time. Need an easier way to keep embeddings up to date.
On Sun, May 12, 2024 at 1:55 AM Joseph Gill @.***> wrote:
Yeah but still a pain point when you have to swap out embeddings en masse, but maybe not all of them.
I’d really like to see a way to have data sources that could have documents or URL’s attached, and then you could refresh those by re-embedding them. It’s like a reusable Refreshable thing instead of a one shot.
Right now it’s kind of in between those two and feels a bit clunky. Don’t get me wrong. It works after things are embedded, and can still get value from it. That’s more than can be said about Lang Chain.
On Sun, May 12, 2024 at 1:51 AM frost19k @.***> wrote:
@atljoseph https://github.com/atljoseph There a button to reset the database in the workspace settings
— Reply to this email directly, view it on GitHub https://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2106129387, or unsubscribe https://github.com/notifications/unsubscribe-auth/AF632FPVBT3RWZ4PITFIRLTZB37MVAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDCMBWGEZDSMZYG4 . You are receiving this because you were mentioned.Message ID: @.***>
Dragging folder does not seem to work reliably. I'm getting "File does not exist in upload directory.". I'm not sure what exactly it means by "not exist" here. The files are there. Is it failing to upload into its own directory?
In this instance, the folder I'm uploading contains several files and multiple levels of subfolders.
I am experiencing the same issue as @atljoseph, but I am not using Docker, just the LMStudio and AnythingLLM implementation.
I am not dragging and dropping. I am just selecting a single pdf file and it shows the same error for me
Changed to a different PC with AVX2 support and I'm still struggling to get it up and running perfectly.
I am unable to upload files.
I'm having trouble when dragging and dropping files or folder, then I can just see a spinner with a timer but nothing is happening, even if it's very small file. Clicking on the box and then selecting file works, but drag and drop doesnt.
This issue seems to be fixed now. I was able to grab a folder with dozens of subfolders and files and drop it in the app.
That's awesome!
I'll was just thinking of giving mine another go again.
Will confirm the results later.
From: Abraão Azevedo @.> Sent: Tuesday, July 30, 2024 2:45 AM To: Mintplex-Labs/anything-llm @.> Cc: Jude Isaiah Cooksey @.>; Comment @.> Subject: Re: [Mintplex-Labs/anything-llm] [BUG]: Can’t import a folder of docs containing other folders. (Issue #1366)
This issue seems to be fixed now. I was able to grab a folder with dozens of subfolders and files and drop it in the app.
— Reply to this email directly, view it on GitHubhttps://github.com/Mintplex-Labs/anything-llm/issues/1366#issuecomment-2257253438, or unsubscribehttps://github.com/notifications/unsubscribe-auth/A2ZNKBBJZWMFTSA5OUYYWNTZO3O3RAVCNFSM6AAAAABHSNSK72VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENJXGI2TGNBTHA. You are receiving this because you commented.Message ID: @.***>
Disclaimer This email and the information contained herein are ADvTECH Ltd confidential and are protected by law. Please navigate to our website for more information https://www.advtech.co.za/ Use of this information or this email by any person for any purposes other than that for which it is intended is prohibited and may result in civil and/or criminal liability. This email is not to be shared with any 3rd parties not included within this email, without the written consent of its Author. If you have received this message in error, please notify ADvTECH immediately, telephone number +27 11 676 8000