skytransfer icon indicating copy to clipboard operation
skytransfer copied to clipboard

Issue with big file tree

Open ilkamo opened this issue 4 years ago • 0 comments

So i did some testing uploading with buckets, made a 100mb, 1, 5, & 10 GB test files. 100mb and 1gb uploaded fine, 5gb caused a browser crash at 99% encryption with an error saying out of memory, 10gb just hung at 76% encryption without a browser crash.

It seems that i can upload files just fine, i can upload folders with files inside them fine, but at some point when there's too many branches on the file tree it just hangs and wont even start to encrypt. (using brave browser if it matters)

Testing different file sizes, i was able to upload up to a 2gb file just fine. 3GB+ causes a browser crash stating a memory error (brave browser) Here's the bucket link if you need it for any reason https://skytransfer.hns.siasky.net/#/v2/0098706e9a954e055a6aa6d9f7cdcf40df1b0b1be11de52c5c3b133737da5d62/3a7b54582d9580d4a19b05025cc9143e27bd548138d33b2e4587429928e423d6a5da40c9f4325e17c4dc8c22678a1f46aca8bb903c180996546103b17596e4ee

a 50mb directory with ~30 files, 200mb with ~100 files. uploaded without issue. A 400mb directory with ~200 files caused the site to hang for a bit but it eventually started uploading fine. Trying with a larger directory now with ~2800 files, just gonna let the site hang and do its thing to see if it works

ilkamo avatar Oct 16 '21 09:10 ilkamo