opensearch-sdk-java icon indicating copy to clipboard operation
opensearch-sdk-java copied to clipboard

Published 20 hours ago • verified publisher icon opensearch-project

[FEATURE] Implement ADTaskManager component

Open dbwiddis opened this issue 2 years ago • 1 comments

Is your feature request related to a problem?

ADTaskManager (part of AD create components) manages historical AD jobs. Unlike other AD components it is highly performance impacting and directly interacts with OpenSearch nodes. It is dependent on the HashRing.

What solution would you like?

This will probably require some functionality on the OpenSearch side to get the node-level details necessary to maintain performance. Having the extension understand the hash ring and directly coordinate with nodes may not be the best solution; it at least should have a design discussion.

dbwiddis avatar Jan 27 '23 23:01 dbwiddis

Creation of the ADTaskManager has been handled by https://github.com/opensearch-project/opensearch-sdk-java/issues/499 for use in StartDetector for real-time analysis tasks, since Job Scheduler is only used to facilitate real-time analysis. Due to this, we have passed in the hashring as null until we add support for historical analysis.

joshpalis avatar Mar 03 '23 21:03 joshpalis