s5cmd
s5cmd copied to clipboard
`sync` command copies object everytime
Native aws s3 sync command copies the file from S3 bucket to local only once (as expected):
aws s3 sync s3://data/testfile .
But s5cmd sync copies the file everytime and overwrites:
s5cmd sync s3://data/testfile .
same
Same with 2.2.2 against MinIO even with --size-only:
$ ./bin/aws s3api head-object --bucket 's5cmd-test' --key 'path/to/libmkl_vml_cmpt.so.1' --query ContentLength
7756240
$ stat -c '%s' /home/groups/.snapshot/groups.daily.latest/path/to/libmkl_vml_cmpt.so.1
7756240
But every time I sync:
$ ./s5cmd_2.2.2 --log=info sync --size-only /home/groups/.snapshot/groups.daily.latest/path/to/libmkl_vml_cmpt.so.1 s3://s5cmd-test/path/to/libmkl_vml_cmpt.so.1
cp /home/groups/.snapshot/groups.daily.latest/path/to/libmkl_vml_cmpt.so.1 s3://s5cmd-test/path/to/libmkl_vml_cmpt.so.1
$