data-prepper icon indicating copy to clipboard operation
data-prepper copied to clipboard

Published 20 hours ago • verified publisher icon opensearch-project

Support Multi-node aggregation by integrating it with the Peer Forwarder

Open dlvenable opened this issue 3 years ago • 1 comments

The aggregate processor as implemented for Data Prepper 1.3.0 will only support single-node deployments. Integrating it into the core Peer Forwarder (#700) will allow it to work with multiple nodes.

dlvenable avatar Feb 04 '22 00:02 dlvenable

~This feature depends on #1189 since the AggregateProcessor is very intentionally not @SingleThread.~

I don't believe this is accurate for this task.

dlvenable avatar Apr 19 '22 22:04 dlvenable

Integrated aggregate processor with core peer forwarder as part of this PR. https://github.com/opensearch-project/data-prepper/pull/1767

asifsmohammed avatar Oct 03 '22 23:10 asifsmohammed