uploadserver icon indicating copy to clipboard operation
uploadserver copied to clipboard

Support for chunked upload

Open maaaaz opened this issue 1 year ago • 3 comments

Hello @Densaugeo,

Your useful program does not currently support chunked upload.

In some cases, such as for instance uploading to a web server exposed by Cloudflare Tunnel, there is a strong limitation of the size of a file uploaded in a request. Without chunk upload, the limit is triggered.

Could you consider adding a chunked upload option in uploadserver ?

Cheers!

maaaaz avatar Dec 05 '24 18:12 maaaaz

I haven't used Cloudflare much. What sort of restriction does it put on upload size?

I'm a little hesitant to add complexity, but I'd be open to it if a simple enough implementation can be found.

Densaugeo avatar Dec 07 '24 22:12 Densaugeo

What sort of restriction does it put on upload size?

Something like 100 MB max per "file", "file" being a non-chunked upload.

I'd be open to it if a simple enough implementation can be found.

https://medium.com/@harshgolu82/streamline-big-data-requesting-data-in-chunks-with-pythons-requests-library-ddc0796b24ff https://gist.github.com/nbari/7335384 https://github.com/mesuutt/python-chunked-upload-example

maaaaz avatar Dec 08 '24 22:12 maaaaz

Could work if handling for partial failures and failures on later chunks can be squeezed in. Ideally I'd like the client to stay under one page of code - this project is intended to be dead simple and have few edge cases.

I'll leave this here in case I (or someone else) finds time.

Densaugeo avatar Dec 31 '24 18:12 Densaugeo