ml4floods icon indicating copy to clipboard operation
ml4floods copied to clipboard

[Models] Notebook with metrics in the WorldFloods test dataset

Open gonzmg88 opened this issue 4 years ago • 0 comments

Things to take into account:

  • [x] Function that given a pytorch dataset returns a confusion matrix (len(dataset), num_class, num_class).
  • [x] Function that takes that and output an JSON of average metrics
  • [ ] Consider that eventually we might want to stratify results by permanent/non-permanent water
  • [ ] Consider that eventually we might want to save the output preds for viz.
  • [ ] Consider functionality to measure performance on a per-flood event basis

gonzmg88 avatar Feb 16 '21 16:02 gonzmg88