Can't upload large file (4GB)

[mjtecka]

(ukrepo)

New -> Item Upload file - 4GB ("myfile", randomly generated from /dev/urandom) - loading went to 2pct and then failed

[kosarko]

To a degree*, that's expected...

• we (@mjtecka and me) should agree on a reasonable file size; that a user can upload without going through extra obstacles; and configure the system accordingly. Does 4GB sound reasonable or should it be more?
• I should add a way to add files above this limit (for admins only)

@milanmajchrak @vidiecan yesterday, you said that an error should be reported right away, if uploading a file above limit. That's not what I'm seeing...the configs are unchanged for now:

/dspace/config# grep -R spring.servlet.multipart.max-
local.cfg.EXAMPLE:#spring.servlet.multipart.max-file-size = 512MB
local.cfg.EXAMPLE:#spring.servlet.multipart.max-request-size = 512MB
clarin-dspace.cfg:spring.servlet.multipart.max-file-size = 4GB
clarin-dspace.cfg:spring.servlet.multipart.max-request-size = 4GB
local.cfg:#spring.servlet.multipart.max-file-size = 512MB
local.cfg:#spring.servlet.multipart.max-request-size = 512MB

I'm testing with a 5G file generated using fallocate as you suggest. The file starts uploading, there's a progress bar, and eventually nginx throws 413 Request Entity Too Large. Is this what you'd expect?

[mjtecka]

We may think about different ways to handle user uploads over some size (for example using API, or some operation involving help by data curator).

Size limit for upload via web interface should be defined, but I think we should be able to handle larger downloads.

[milanmajchrak]

We discovered that this error occurred due to the Nginx setup. I think we solved it here: https://github.com/dataquest-dev/DSpace/issues/532