skyplane
skyplane copied to clipboard
[request] Enable multipart for on-prem transfers
Please describe problem to be solved
The current on-prem implementation #735 does not have multipart transfers implemented. This is relatively straightforward for ext4fs/nfs, but will need some work for HDFS given our design choices. This is important to realize the potential benefits of parallel transfers on-prem.