bpozdena
[BUG] Crashes after a while when uploading large amount of files
Describe the bug I am uploading a very large amount of files (hundres of thousands tiny files) and after a while (15-30 min) the window stops responding and most of the times crashes after a while after that. the sync progress is not stopped but the window not being usable after a while is annoying since when you interact with it while not responding it will try to force close and i also cant turn off my pc without force killing both the python3 and onedrive process
To Reproduce Steps to reproduce the behavior:
- Open OneDriveGUI by ...
- Start sync
- Upload very large amount of files ...
Expected behavior it should just upload all files without crashing
Screenshots
Log
If applicable, add relevant output from log file /tmp/onedrive-gui/onedrive-gui.log.
log is 300 mb at this point so too large to upload so here is a link to it
https://file.io/KzckMi6oujl8
...
System Info
- Linux distribution: Cachyos Arch Linux 6.12.1-2-cachyos
- Desktop environment: KDE Plasma 6.2.3
- Compositor: Wayland
- Python version: 3.12.7
- Version of OneDrive client: 2.5.3
OneDriveGUI info How did you install OneDriveGUI?: AUR What is the name of the AppImage file (if applicable)? : [e.g. OneDriveGUI-1.1.0-x86_64.AppImage ]
Can you please share how many files are in your sync dir? Also how many new files do you need to sync on daily bases?
Around 1 million. And i dont need to sync that much on a daily basis. I just need to upload once for a backup.
From: Boris Pozdena @.> Sent: Monday, November 25, 2024 10:34:57 PM To: bpozdena/OneDriveGUI @.> Cc: Jochem Kuipers @.>; Author @.> Subject: Re: [bpozdena/OneDriveGUI] [BUG] Crashes after a while when uploading large amount of files (Issue #208)
Can you please share how many files are in your sync dir? Also how many new files do you need to sync on daily bases?
— Reply to this email directly, view it on GitHubhttps://github.com/bpozdena/OneDriveGUI/issues/208#issuecomment-2499082605, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BK6ALSZ5HLGSDBQLONSHRPD2COJXZAVCNFSM6AAAAABSO4ZN7KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOJZGA4DENRQGU. You are receiving this because you authored the thread.Message ID: @.***>
Ok, I never tested it past the recommended maximum of 300.000 .
The GUI probably becomes unresponsive when the number of items in the list is too huge. I never had a reason to limit this, but it looks like I will have to.
I'm not sure when I'll get time for new GUI release. For now I'd recommend you to complete the full sync using the CLI, or just keep the GUI hidden. Once all is in sync, you should not hit this issue on daily bases anymore.
Thank you for the quick reply. I will do exactly that then. Have a very nice day.
From: Boris Pozdena @.> Sent: Monday, November 25, 2024 10:50:50 PM To: bpozdena/OneDriveGUI @.> Cc: Jochem Kuipers @.>; Author @.> Subject: Re: [bpozdena/OneDriveGUI] [BUG] Crashes after a while when uploading large amount of files (Issue #208)
Ok, I never tested it past the recommended maximum of 300.000https://support.microsoft.com/en-us/office/restrictions-and-limitations-in-onedrive-and-sharepoint-64883a5d-228e-48f5-b3d2-eb39e07630fa#numberitemscanbesynced .
The GUI probably becomes unresponsive when the number of items in the list is too huge. I never had a reason to limit this, but it looks like I will have to.
I'm not sure when I'll get time for new GUI release. For now I'd recommend you to complete the full sync using the CLI, or just keep the GUI hidden. Once all is in sync, you should not hit this issue on daily bases anymore.
— Reply to this email directly, view it on GitHubhttps://github.com/bpozdena/OneDriveGUI/issues/208#issuecomment-2499107970, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BK6ALSZSQFCEAFTWPAW4BP32COLTVAVCNFSM6AAAAABSO4ZN7KVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDIOJZGEYDOOJXGA. You are receiving this because you authored the thread.Message ID: @.***>
+1 to this. I had the same issue while syncing a local 126 GB folder with 118K files and 500 sub-folders (reported by Dolphin on Kubuntu 23.04). Although in my case the window responded after a long wait after interacting with it. It usually freezed after minimizing or sending to tray and restoring.
I also noticed the app becomes slow to navigate when there are many entries in the GUI list of synced files.
A solution could be that the list is a circular buffer, i.e. passing a certain amount of elements a new insertion deletes the oldest one.
