Does recursive get work?

[svohara]

I'm simply trying to download a bunch of files from s3, in a recursive manner. I am using the common convention that the s3 objects and prefixes can be viewed as directories and files, using "/" as the separator.

the following works using s3cmd: s3cmd get -rf s3://bucket_name/ ./dirname/

the following does not work with s4cmd, using the exact same source/target locations: s4cmd get -rf s3://bucket_name/ ./dirname/

I get errors like: [Runtime Failure] Download Failure: , Source: s3://bucket/subdir/. [Runtime Failure] Download Failure: , Source: s3://bucket/subdir/subdir2/subdir3a/. [Runtime Failure] Download Failure: , Source: s3://bucket/subdir/subdir2/. [Runtime Failure] Download Failure: , Source: s3://bucket/subdir/subdir2/subdir3b/. [OSError] 2: No such file or directory [OSError] 2: No such file or directory [OSError] 2: No such file or directory ....

Is not s4cmd supposed to be drop-in replacement for s3cmd for these types of things? Does anyone have any troubleshooting advice? Can you point me to a public-access bucket on s3 where I can reproduce a recursive download using s4cmd?

[navinpai]

Hey, I am unable to reproduce this issue. Can you please let me know the following:

• Is this still an issue?

If yes, then:

• Which version of s4cmd are you using
• What version of python are you running?
• How many files are in your s3 bucket?
• Is this issue affecting every file or just some files throw an error?