MEGAsync icon indicating copy to clipboard operation
MEGAsync copied to clipboard

Mega v5.6.0 - Download/Upload a folder with 5m - 10m small files results on crushes/bugs

Open itayasaf2001xd opened this issue 1 year ago • 4 comments

Try to download or upload a folder that contains around 5 to 10 million small files some of which need 3rd extension to get encrypted or decrypted and the download speed and the responsiveness of the UI will be really slow and even crash.

For example, I have a big collection of old abandonware games/pictures/audio files I downloaded from verity of places such as: https://www.myabandonware.com/ https://archive.org

Please try for yourself, download and create a folder with 5 to 10 million and try to upload it or, and then download it.

itayasaf2001xd avatar Oct 31 '24 13:10 itayasaf2001xd

Hi, could you specify the files that need 3rd extension encryptions? What format are those files? Are you encrypting or decrypting meanwhile transferring to MEGA?

jx-mega avatar Oct 31 '24 16:10 jx-mega

Hi, could you specify the files that need 3rd extension encryptions? What format are those files? Are you encrypting or decrypting meanwhile transferring to MEGA?

Hi,

To clarify, I’m not using any encryption on the files. I recall having issues with a few files, and Mega support mentioned that they use third-party libraries for their encryption process.

As I mentioned earlier, you can download files from the following links:

My Abandonware Internet Archive

I typically upload various file types, including ISO, MP4, MP3, MKV, and FLA. I often save old games as plain files, extracting everything from the ISO out. This usually results in 1,000 to 5,000 individual files per game. Given that I have around 1,000 to 2,000 old games, that adds up to approximately 4 to 5 million small files.

When I attempt to upload or download in bulk—whether it’s 500,000 to 1 million files—the GUI often freezes or crashes. If it manages to stay responsive, the upload/download speeds tend to be very slow.

itayasaf2001xd avatar Nov 03 '24 20:11 itayasaf2001xd

Hi, We are working on some stability issues for 5.7.0 version regarding with media file processing. Meanwhile, you can launch megasync.exe (full path) through powershell with the option /nogfx which will disable media processing for files, just in case the issue comes from a third partly media lib.

& $env:localappdata\MEGAsync\MEGAsync.exe /nogfx

You can reach our support team for further assistance, log files and provide crash stack trace, so we can confirm you if the problem comes from graphics processor or it is a different one. Use the "Report issue" option from general tab in settings dialog.

Regards.

vtmateos avatar Nov 18 '24 12:11 vtmateos

Hi, We are working on some stability issues for 5.7.0 version regarding with media file processing. Meanwhile, you can launch megasync.exe (full path) through powershell with the option /nogfx which will disable media processing for files, just in case the issue comes from a third partly media lib.

& $env:localappdata\MEGAsync\MEGAsync.exe /nogfx

You can reach our support team for further assistance, log files and provide crash stack trace, so we can confirm you if the problem comes from graphics processor or it is a different one. Use the "Report issue" option from general tab in settings dialog.

Regards.

I’d like to share my experience as well. Currently, I'm using MegaSync version 5.8.0. While there have been some improvements, it still struggles with handling large files (2-3 million or more). The application tends to freeze/slow down on download/upload speed, even though I have a 1GB fiber internet connection, an i7 14th-gen processor, 64GB of RAM, and an RTX 3080 Ti, with downloads/uploads occurring on an SSD .nvme.

Biyakuga avatar Mar 07 '25 16:03 Biyakuga