numalogic icon indicating copy to clipboard operation
numalogic copied to clipboard

Support training for latency based anomalies specifically for perf-anomaly

Open shashank10456 opened this issue 5 months ago • 2 comments

Explain what this PR does.

This PR supports Anomaly Detection on fields that use valuesDoubleSketches. We add aggregations and postaggregations which run natively on druid. These sketches are converted to values using these postaggregations and are run on druid. This would enable us to use anomaly detection for inputs using sketches(https://datasketches.apache.org/). For example, latency based anomaly.

Also, I have made few changes to DockerFile and added a patch for Numalogic 0.9.1 to avoid CVE issues. This is important for the perf-anomaly team to avoid moving to Numaflow 1.2.1 and updating all the UDFs and UDSinks. This would help them save lot of time by just upgrading the ML vertices.

shashank10456 avatar Sep 10 '24 19:09 shashank10456