data-prepper icon indicating copy to clipboard operation
data-prepper copied to clipboard

Support JSON configuration files

Open graytaylor0 opened this issue 3 years ago • 5 comments

Is your feature request related to a problem? Please describe. As a user that prefers JSON over YAML, I would like the option to configure Data Prepper using a JSON configuration file.

Describe the solution you'd like Data Prepper supports both YAML and JSON configuration files

Additional context This is a relatively minor change, as Jackson can easily convert JSON to YAML internally. However, it may be necessary to provide JSON configuration examples along with the YAML examples in the documentation. However, since YAML is the main way to configure Data Prepper, this may not be completely necessary.

Is there a concern that having 50% of users on YAML and 50% on JSON would cause more confusion that necessary? Or does the option to use JSON outweigh this concern?

Tasks

  • [ ] Unit or integration tests for pipeline JSON
  • [ ] Include .json extension when scanning the pipelines/ directory
  • [ ] Read each .json and .yaml file independently when constructing the pipeline
  • [ ] Documentation updates

graytaylor0 avatar Feb 09 '22 19:02 graytaylor0