fluent-plugin-s3 icon indicating copy to clipboard operation
fluent-plugin-s3 copied to clipboard

Multiple S3 buckets support for input, dynamic bucket names from SQS, and queue url override

Open abdullahzen opened this issue 4 years ago • 3 comments

Changes made:

  • Allowing multiple s3 bucket names in the input s3 plugin and preserving the previous functionality with a single bucket name
  • Added dynamic fetching of objects by bucket names returned by SQS. (while checking that the returned bucket name is one of the bucket names that were provided in the s3_buckets and were verified)
  • Added queue url to the sqs section in the parameters to override calling get_queue_url in some cases where get_queue_url is not allowed for specific IAM users.
  • Changed the default tag to include the bucket name

Fixes #342 : Usually this error is returned when the user doesn't have permission to call get_queue_url

abdullahzen avatar Dec 24 '20 06:12 abdullahzen

@cosmo0920 Can I get a review? thank you!

abdullahzen avatar Jan 30 '21 02:01 abdullahzen

This PR has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this PR will be closed in 30 days

github-actions[bot] avatar Jul 06 '21 10:07 github-actions[bot]

This PR has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this PR will be closed in 30 days

github-actions[bot] avatar Oct 07 '21 10:10 github-actions[bot]