aws
Add --include-file and --exclude-file options
Fixes #5160
Add two new options to several s3 commands to include or exclude all patterns from a file.
By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.
merge the data field and vendor info. and do the selected file ratio and contability graph.
@amberkushwaha931 I don't understand what you are trying to say. what data field and vendor info? what is the selected file ratio and contability graph?
Hey, thanks for this PR and for your patience. I brought this up to the team, and we've decided to close this as not planned. We'll be leaving the feature request (https://github.com/aws/aws-cli/issues/5160) open for tracking purposes, but we will not be merging this.
What is the reason for not adding this feature?
Having to invoke the aws cli for each file individually is significantly slower, since you have to pay the cost of starting the python interpretor, loading modules, etc. Passing all the files on the command line is limited, because there is a maximum size for the command line.
The only viable option if you need to synchronize a large number of files is to write your own script using the SDK. But that involves having to duplicate a lot of what the CLI already does, especially if you want things like parallelization, conditional uploads/downloads, progress reporting, etc.