data-prepper icon indicating copy to clipboard operation
data-prepper copied to clipboard

Read http basic auth username and password from secret manager

Open dinujoh opened this issue 2 years ago • 1 comments

Is your feature request related to a problem? Please describe. The current Data Prepper Authentication implementation of http basic auth requires the username and password to be provided as clear text in the Data Prepper pipeline configuration file. Data Prepper doesn't support use of certificate or docker secrets to set the login/password. It would be nice to read the username/password from some secret manager or other medium instead of having it as plain text in the configuration file.

Describe the solution you'd like Create implementation of ArmeriaHttpAuthenticationProvider to read the http basic username and password from a given type of secret manager such as docker secret.

Describe alternatives you've considered (Optional)

  • Support reading the credentials from certificate.
  • Support reading the credentials from secret manager such as AWS Secret Manager.

Additional context Related data prepper opensearch forum post.

dinujoh avatar Oct 17 '22 23:10 dinujoh

Data Prepper has an open issue to provide a generic mechanism for getting secrets in #949. Using AWS Secrets Manager should be one option within the solution provided by #949.

dlvenable avatar Oct 18 '22 14:10 dlvenable

Reading credentials from AWS Secret Manager is requested in #1679 .

This issue is different though because it also requests using AWS Secret Manager for authentication credentials such as username/password.

dlvenable avatar Nov 03 '22 17:11 dlvenable