data-prepper
data-prepper copied to clipboard
Support JSON configuration files
Is your feature request related to a problem? Please describe. As a user that prefers JSON over YAML, I would like the option to configure Data Prepper using a JSON configuration file.
Describe the solution you'd like Data Prepper supports both YAML and JSON configuration files
Additional context This is a relatively minor change, as Jackson can easily convert JSON to YAML internally. However, it may be necessary to provide JSON configuration examples along with the YAML examples in the documentation. However, since YAML is the main way to configure Data Prepper, this may not be completely necessary.
Is there a concern that having 50% of users on YAML and 50% on JSON would cause more confusion that necessary? Or does the option to use JSON outweigh this concern?
Tasks
- [ ] Unit or integration tests for pipeline JSON
- [ ] Include
.json
extension when scanning thepipelines/
directory - [ ] Read each
.json
and.yaml
file independently when constructing the pipeline - [ ] Documentation updates