Taylor Gray

[BUG] Flaky tests high-level tracking

16

**Describe the bug** Running the data-prepper build and github actions frequently has failing flaky tests, and often requires retrying the tests multiple times before it succeeds. This issue is meant...

Validate data prepper configurations without running Data Prepper

4

**Is your feature request related to a problem? Please describe.** As a user of data prepper, I would like to be able to validate my pipeline configurations without having to...

**Is your feature request related to a problem? Please describe.** As a user of Data Prepper's DLQ, I would like to also get the metadata of Events in the case...

Support JSON configuration files

5

**Is your feature request related to a problem? Please describe.** As a user that prefers JSON over YAML, I would like the option to configure Data Prepper using a JSON...

Create a decoder processor to decode Event keys

6

**Is your feature request related to a problem? Please describe.** As a user of Data Prepper, my Events contain keys that are encoded in different formats, such as `gzip`, `base64`,...

Allow configurable file_pattern in s3 sink object_keys

1

**Is your feature request related to a problem? Please describe.** The s3 sink defaults to https://github.com/opensearch-project/data-prepper/blob/c45ddb15f9fc8803655e4879d3d3494ede937b0d/data-prepper-plugins/s3-sink/src/main/java/org/opensearch/dataprepper/plugins/sink/s3/configuration/ObjectKeyOptions.java#L14 and is not configurable. **Describe the solution you'd like** As a user of Data...

[BUG] OpenSearch Serverless Sink does not create index on startup

2

**Describe the bug** When using an OpenSearch Serverless collection in a pipeline in the `opensearch` sink, the index configured is not created until a document is sent to the pipeline...

**Is your feature request related to a problem? Please describe.** As a user of the OpenSearch source, I would like to only do a one-time list of the indices rather...

Support regex patterns for the exclude_suffix in s3 scan

1

**Is your feature request related to a problem? Please describe.** As a user of the s3 source with scan, I would like to be able to exclude objects from processing...

[BUG] Index template_file and template_content truncates index pattern incorrectly

1

**Describe the bug** Index patterns are being created with a truncated index pattern from the index template index patterns passed in the config This bug occurs when there is no...