data-prepper
data-prepper copied to clipboard
Read http basic auth username and password from secret manager
Is your feature request related to a problem? Please describe. The current Data Prepper Authentication implementation of http basic auth requires the username and password to be provided as clear text in the Data Prepper pipeline configuration file. Data Prepper doesn't support use of certificate or docker secrets to set the login/password. It would be nice to read the username/password from some secret manager or other medium instead of having it as plain text in the configuration file.
Describe the solution you'd like Create implementation of ArmeriaHttpAuthenticationProvider to read the http basic username and password from a given type of secret manager such as docker secret.
Describe alternatives you've considered (Optional)
- Support reading the credentials from certificate.
- Support reading the credentials from secret manager such as AWS Secret Manager.
Additional context Related data prepper opensearch forum post.
Data Prepper has an open issue to provide a generic mechanism for getting secrets in #949. Using AWS Secrets Manager should be one option within the solution provided by #949.
Reading credentials from AWS Secret Manager is requested in #1679 .
This issue is different though because it also requests using AWS Secret Manager for authentication credentials such as username/password.