s5cmd
s5cmd copied to clipboard
Parallel S3 and local filesystem execution tool.
This commit adds support for the `--start-after` parameter to enable pagination when listing S3 objects, allowing users to resume listing from a specific key. Changes: - storage/url: Add StartAfter field...
stdlib-go1.22.10 is causing critical vulnerabilities--upgraded go to 1.25.2 which addresses these vulnerabilities Fixes peak/s5cmd#820
- Allow --profile to use AWS credential chain instead of forcing ~/.aws/credentials - Add Profile field to session.Options for proper shared config loading - Maintains backward compatibility for --credentials-file usage...
If you `s5cmd mv` data from a local source with nested directory structure to s3 it leaves all of the directories behind. It would be very helpful to have an...
Hi, We have a job that runs on a server in Denmark, which uses s5cmd cp to copy to an S3 bucket in eu-west-2 (London). As there's currently 1 hour...
I checked through the code and couldnt see any kind of parallelism, how does this work?
Adding buffers for `s3manager` Uploader and Downloader to increase buffer sizes for filesystem calls. This makes sense when using network block devices (commonly used in compute clouds)
Reference: https://github.com/peak/s5cmd/pull/552
Updating the `lanrat/extsort` version to fix a panic: https://github.com/lanrat/extsort/issues/10 tl;dr: This panic is caused when running `s5cmd` without enough memory, causing a fallback to extsort, and also running out of...
The `minio` image was removed entirely from the `bitnami` repository and made available in `bitnamilegacy`. This is currently causing the CI to fail. Updated the workflow definition to pull the...