beats icon indicating copy to clipboard operation
beats copied to clipboard

Harmonize redis intput/module/output settings

Open urso opened this issue 5 years ago • 10 comments

With 7.7.0 we are introducing support for configuring the redis host via URLs in the output. In Beats we have a Filebeat redis logs input (collect logs, not event stream input), Metricbeat redis module, and the redis output. The different plugins should provide a similar set of settings and connection capabilites (x=present, -=missing):

settings output FB input MB module
redis:// URL x - x
rediss:// URL x - -
URL options - - x
URL db number - - x
ssl settings x - -
proxy x - -
proxy local resolver x - -

urso avatar Feb 24 '20 16:02 urso

Client library used in Metricbeat already supports rediss URLs and TLS settings (since https://github.com/gomodule/redigo/pull/208), but we are using an older version :slightly_frowning_face: A good starting point could be to upgrade the library.

jsoriano avatar Apr 09 '20 12:04 jsoriano

Pinging @elastic/integrations (Team:Integrations)

elasticmachine avatar Mar 04 '21 09:03 elasticmachine

I see the client library has been updated, any eta for the Metricbeat module to support ACLs and TLS settings for Redis?

wsucoug69 avatar Jul 26 '21 16:07 wsucoug69

Hi, Is this issue still open for MB ?

umeshauv avatar Oct 26 '21 20:10 umeshauv

Hi! We just realized that we haven't looked into this issue in a while. We're sorry!

We're labeling this issue as Stale to make it hit our filters and make sure we get back to it as soon as possible. In the meantime, it'd be extremely helpful if you could take a look at it as well and confirm its relevance. A simple comment with a nice emoji will be enough :+1. Thank you for your contribution!

botelastic[bot] avatar Mar 31 '23 13:03 botelastic[bot]

TLS still not supported to redis module for metricbeat? I tried on metricbeat 7.17.3 and I get timeout errors connecting to the redis.

j771 avatar Jul 05 '23 19:07 j771

@jsoriano that would also require using the URL dialer.

@jlind23 how fast would it take to upstream TLS support for this module should we decide to submit a patch?

wizardist avatar Apr 03 '24 08:04 wizardist

@wizardist this is a bit out of my wheelhouse but @lalit-satapathy might be able to help as this is own by his team.

jlind23 avatar Apr 03 '24 09:04 jlind23

Support for SSL/ TLS was added for metricbeat's Redis module but not in the filebeat input.

See: https://github.com/elastic/beats/pull/35240 (metricbeat TLS support) See: https://github.com/elastic/beats/issues/39412 (open issue to add filebeat input Redis TLS support)

We are planning to take this up in our upcoming sprints to add SSL/TLS support in the filebeat input.

cc: @lalit-satapathy @gpop63

shmsr avatar Jul 01 '24 11:07 shmsr

Adding @gpop63 to enable the remaining one.

lalit-satapathy avatar Jul 01 '24 11:07 lalit-satapathy