File not found after try to load metadata from amazon, where amazon server responds error 503

[Valkryst]

Is your feature request related to a problem? Please describe.

I have a handful of excessively large PDF files (500MB to 5.5GB) which I would like to store and access with calibre-web.

While attempting to upload these files, I ran into a number of issues which I assumed were caused by Nginx. After combing through the logs, changing reverse-proxy settings, and troubleshooting as much as I could, I realized the issue was with calibre-web. There is a hardcoded max_buffer_size which is around 200MB and which prevents larger files from being uploaded.

Though this is entirely reasonable for 99% of the files that I've uploaded thus far, it's preventing me from uploading these files.

Describe the solution you'd like

I would like a new option to be added to the admin UI, allowing the user to select a higher max_buffer_size, and for any relevant code to be updated to work with larger files.

Describe alternatives you've considered

I have manually edited the hardcoded max_buffer_size to allow for files up to 6GB, but it seems as though there are still issues with files around 800MB and up.

The upload will appear to succeed, but any changes to the book's metadata will fail to save. It appears as though the file can't be found in the expected location, and calibre-web silently fails.

I could also manually upload the files VIA FTP, if there were instructions on how to add them to calibre-web.