fluent-plugin-s3

fluent-plugin-s3 copied to clipboard

how to configure to store to own s3 with building Ceph

4

jaywayjayway

Hello, We are using following versions of FluentD and FluentD-S3 Plugin in Kubernetes Environment. ``` 2021-07-06 16:11:09 +0000 [info]: gem 'fluent-plugin-s3' version '1.5.1' 2021-07-06 16:11:09 +0000 [info]: gem 'fluentd' version...

imran9m

Support for directly specifying temporary credentials

7

I use IAM roles with MFA. Thus, I see no way to support passing the 3 values in directly: * access key ID * secret access key * session token...

et304383

fluent-plugin-s3 it fail to auto clean up the buffer's files after pushing to S3

7

I also encountered the problem that the files in the buffer could not be automatically deleted after the push。 ``` @type file path /etc/fluentd/temp/moons timekey_wait 5 timekey 1 chunk_limit_size 256m...

ZP-AlwaysWin

Log pushed using s3 output plugin throws error "2020-06-16 13:23:35 +0000 [warn]: #0 [out_s3] buffer flush took longer time than slow_flush_log_threshold: elapsed_time=44.62332443147898 slow_flush_log_threshold=20.0 plugin_id="out_s3""

4

Hi team, Below is my config for td-agent :: # Include config files in the ./config.d directory @include config.d/*.conf @type s3 @id out_s3 @log_level debug aws_key_id "xx aws_sec_key "xx s3_bucket...

shilpasshetty

We use kubernates/fluentd cluster and issue `instance_profile_credentials` options for S3 writes. Local docker development conflicts with the above setup and forcing us to use "shared_credentials". Please share some thoughts on...

sadhasivam

Allow to ignore events that point to a file on s3 of size 0

1

### Is your feature request related to a problem? Please describe. We try to parse ALB logs from AWS. They are pushed to s3. This is set up by AWS,...

pieterjanpintens

s3_object_key_format without index overwrites (not append) log files

11

### Describe the bug Hello there! I use fluentd v1.16 and fluent-plugin-s3 and according my configuration it should send logs from few files to MinIO once per day. Hers is...

arepusb

Append file support

3

### Is your feature request related to a problem? Please describe. From my current understanding, log file is visible after a timekey interval or a buffer size. If we configure...

raultang

ENHANCEMENT: add the additional checksum as a supported put parameter

5

Hi, I'm proposing this Pull Request because S3 supports additional checksum options for creating the hash at the upload. I tested it on my side and it works. What do...

joe-pll