moa icon indicating copy to clipboard operation
moa copied to clipboard

Add PredictionLoggerEvaluator

Open tachyonicClock opened this issue 2 years ago • 0 comments

  • LearningPerformanceEvaluator is now AutoCloseable to ensure PredictionLoggerEvaluator can flush predictions.
  • PredictionLoggerEvaluator can wrap another ClassificationPerformanceEvaluator.
  • Removed outputPredictionFile from classification tasks because it is redundant now.
  • Ensures all tasks close the evaluators.
  • Saves a gzip compressed CSV by default.
  • PredictionLoggerEvaluator only supports classification.

MOA GUI with PredictionLoggerEvaluator's default options

Output with probabilities:

true_class,class_prediction,class_probability_0,class_probability_1,
1,0,0.00,0.00,
1,0,0.00,0.00,
0,1,0.00,1.00,
0,1,0.33,0.67,
1,0,0.50,0.50,
0,0,1.00,0.00,

Output without probabilities:

true_class,class_prediction,
1,0,
1,0,
0,1,
0,1,
1,0,
0,0,
1,1,

Some tests fail but I believe these fail on master: Pasted image 20230921134835

tachyonicClock avatar Sep 21 '23 02:09 tachyonicClock