evalutils

evalutils helps challenge administrators easily create evaluation containers for grand-challenge.org.

• Free software: MIT license
• Documentation: https://comic.github.io/evalutils/.

Features

• Generation your challenge evaluation project boilerplate using Cookiecutter
• Scripts to build, test and export your generated docker container for grand-challenge.org
• Loading of CSV, ITK and Pillow compatible prediction files
• Validation of submitted predictions
• Interface to SciKit-Learn metrics and Pandas aggregations
• Bounding box annotations with Jaccard Index calculations

Getting Started

evalutils requires Python 3.8 or above, and can be installed from pip. Please see the Getting Started documentation for more details.