David Venable

Results 342 comments of David Venable

@Megharaj-N , In 2.7 we changed the behavior of the source to output individual metrics instead of the whole group. You can multiply your buffer size by what your typical...

@graytaylor0 , Data Prepper has an option for controlling the shutdown behavior already. ``` pipeline_shutdown: on-any-pipeline-failure ``` When any pipeline fails, Data Prepper will shutdown when the following is set...

I like this proposal for truly common labels. But please also keep in mind that not all projects have the OpenSearch versioning. Data Prepper continues to receive labels for OpenSearch...

Rather than continuing to include the `pipelineName` in the metric name, I think making use of Micrometer tags would allow for better metrics. This would map to Amazon CloudWatch metrics...

We should also make changes to the metrics to differentiate between the plugin types. This may be done well through the use of a tag to indicate the type.

We can work this along with #4195 to greatly improve our error logging.

@Jon-AtAWS , Yes, I agree with this. @kkondaka , I think we could accomplish this by adding a try-catch when making the call. Maybe we can even have a special...

> `throw new OpenSearchRequestException("checking that index exists.", ex);` > > Thanks @dlvenable ! > > Nitpicking a bit - let's pack as much information in these messages as possible. For...

@chenqi0805 , There are two things you need to do to get this PR ready: 1. Rebase from main. In #7708, I renamed this processor already. You might not even...

We can close this once #4921 is merged.