RNN-Time-series-Anomaly-Detection icon indicating copy to clipboard operation
RNN-Time-series-Anomaly-Detection copied to clipboard

Is it unsupervised learning? Why is the label needed?

Open yunzhonghe2017 opened this issue 5 years ago • 4 comments

I can't understand why the label is needed. default

I think the train data does not contain anomalies and the test data contains anomalies. So, I process my data as follow, the train data is the normal historical data while the test data contains man-made anomalies, but the result is disappointing. What can I do? 1

yunzhonghe2017 avatar Nov 19 '18 03:11 yunzhonghe2017

Is it unsupervised learning? Yes. The network in this repo is trained as a non-supervised learning method. Labels are not used when training.

Why is the label needed? Labels are needed to evaluate model performance. If there is no label, how can we evaluate the accuracy of the model?

I think the train data does not contain anomalies and the test data contains anomalies. So, I process my data as follow, the train data is the normal historical data while the test data contains man-made anomalies, but the result is disappointing. What can I do? What does your data look like? Is the data periodic? I think the method seems hard to detect anomalies of aperiodic data.

chickenbestlover avatar Nov 19 '18 05:11 chickenbestlover

result analysis As the picture above, the data is periodic. I do not know which data should be labeled 1 and which data should be labeled 0 as my train data has no anomaly while the test data contains anomalies, and they are collected respectively in different situation as follow: 2 @chickenbestlover

yunzhonghe2017 avatar Nov 19 '18 06:11 yunzhonghe2017

Wow, your data looks really cool! I never tried 16-dimensional data simply because I don't have one. I cannot find any anomalous points in your data. Is this figure test dataset which contains anomalous points? If so, where are anomalous points? And from which sensor did you get the last anomaly scores?

chickenbestlover avatar Nov 21 '18 11:11 chickenbestlover

result analysis As the picture above, the data is periodic. I do not know which data should be labeled 1 and which data should be labeled 0 as my train data has no anomaly while the test data contains anomalies, and they are collected respectively in different situation as follow: 2 @chickenbestlover

Can it be real-time monitoring?

Rmj009 avatar Jun 20 '19 10:06 Rmj009