fluent-plugin-s3

fluent-plugin-s3 copied to clipboard

instance_profile_credentials are not allowing uploads to my S3 bucket

1

### Describe the bug As my logs are being written to stdout, they are not uploading to the S3 bucket. It works correctly if I specify the aws_key_id and aws_sec_key...

NickBrinsmade

### Is your feature request related to a problem? Please describe. I noticed me and many users are wondering to be able to recognize logs that are on many lines....

valentinacala

s3 input is not separating log entries

3

### Describe the bug Using s3 input from cloudwatch logs (gzipped json) to send to opensearch, and all entries from each log file in s3 are being put into one...

tfmm

fluent-plugin-s3 doesn't seem to work with AWS short-term credentials

2

### Describe the bug I have been trying to upload aggregated logs through fluentD to an s3 bucket. The entire set-up works if I use AWS long-term access keys but...

sanjay-curium

td-agent is able to run columnify -h yet td-agent throwing err

2

### Describe the bug td-agent is able to run columnify -h yet td-agent throwing err ```console $ su - td-agent -c "columnify -h" Usage of columnify: columnify [-flags] [input files]...

DivyaYash

When match_regexp not matched, message is discarded

1

### Describe the bug Although the `aws_sdk_sqs/queue_poller` module does indeed delete only at the end of the code block passed to it while polling (assuming `:skip_delete` is `false`), the use...

jasonreevessimmons

Add debug log after s3 put

1

### Is your feature request related to a problem? Please describe.  We'd like to send relatively large size data to Kinesis Data Streams. Due to the price problem, I'm...

statefb

Invalid Credential Will Crash the Fluentd Worker

1

### Is your feature request related to a problem? Please describe. My environment is: `td-agent 4.4.1 fluentd 1.15.2 (c32842297ed2c306f1b841a8f6e55bdd0f1cb27f)` With the latest s3 plugin as for submitting this request. Here...

yangjiel

S3 output filling up /tmp

2

### Describe the bug I have these files on /tmp filling up disk space and they are not removed by fluentd ``` 30M s3-20230115-3429444-1n0gm68 34M s3-20230118-4051437-8mi5ts 36M s3-20230105-1633445-ymzdql 44M s3-20230118-4082680-1v29q88...

waqarsky

gem dependency conflict

2

### Describe the bug I am running `RUN fluent-gem install elasticsearch -v 8.6.0 && fluent-gem install fluent-plugin-elasticsearch fluent-plugin-s3 elasticsearch-api` in my Dockerfile, two versions of `faraday` will be installed (2.7.3,...

fabifont