manifold icon indicating copy to clipboard operation
manifold copied to clipboard

Support multi-class classification

Open Firenze11 opened this issue 5 years ago • 1 comments

Summary

The project currently doesn't support multiclass classification models, this should be valuable and relatively simple to implement.

Possible Solution

  • Each yPred files have multiple columns, each indicating predicted probability of one class
  • Automatic clustering algorithm uses nModels * (nClasses - 1) columns to do segmentation
  • Visualization doesn't have to change since one data point is still associated with one metric per model, which is the log-loss.
  • If users want to segment by performance on one single class, we can implement that based on user-defined performance metric (#105), where user specify the metric to be some sort of loss function comparing the prediction for class N with the ground truth for class N

Firenze11 avatar Feb 23 '20 01:02 Firenze11

Does it support object detection models? If yes, how do i prepare my prediction data for manifold to be able to visualize model performace. what would be the contents of features dataset, pixel values?

imneonizer avatar Apr 16 '20 09:04 imneonizer