logstash-output-s3 icon indicating copy to clipboard operation
logstash-output-s3 copied to clipboard

additional_settings force_path_style config option ignored

Open gnur opened this issue 7 years ago • 2 comments

It seems that force_path_style in additional settings is not working.

  • Version: docker bases logstash 6.2.4

  • Config File (if you have sensitive info, please remove it):

input {
     beats {
         port => 5044
     }
 }
 
 
 output {
       stdout { }
       s3{
         access_key_id => ""
         secret_access_key => ""
         region => "eu-west-1"
         endpoint => "http://localhost:9000"
 
         bucket => "test"
         additional_settings => {
             force_path_style => true
             follow_redirects => false
         }
       }
 }
  • Steps to Reproduce: Start logstash with this configuration.

[2018-05-14T10:03:32,156][ERROR][logstash.outputs.s3 ] Error validating bucket write permissions! {:message=>"Connection refused - Failed to open TCP connection to test.localhost:9000 (Connection refused - connect(2) for \"test.local

It appears this makes logstash connect to test.localhost:9000, but I believe force_path_style should make sure the endpoint isn't updated.

Use case: I'm using minio to archive data, but it cannot connect because test.localhost isn't defined. And when using an external minio instance secured by a letsencrypt certificate it is trying to connect to "bucketname.s3.example.com", which off course is not secured.

gnur avatar May 14 '18 10:05 gnur

this has been solved in https://github.com/logstash-plugins/logstash-output-s3/pull/179, can you update the plugin and confirm?

jsvd avatar May 14 '18 10:05 jsvd

Is there an official docker release available? The latest I could find was 6.2.4

gnur avatar May 14 '18 10:05 gnur