awesome-mecheng
awesome-mecheng copied to clipboard
Scoring: exclude_from_ranking
Part of the tiny pitch:
- https://github.com/DIAGNijmegen/rse-roadmap/issues/322
This PR adds an optional (default: false) exclude_from_ranking
field in the extra results columns JSON definition. Setting it to true
allows additional metrics to be shown on Challenge leaderboards while being ignored while calculating the rank.
The related test is a construction copy of test_calculate_ranks
since I did not find it wise to extend that test with yet another factor. It would have pushed the 12 (2x3x2) to 24 which is over the top imho.