medperf
medperf copied to clipboard
[FEATURE] log inference times
Is your feature request related to a problem? Please describe. We need to know the inference times of algorithms per exam.
Describe the solution you'd like Medperf should log and return inference times in milliseconds.
Additional context Email conversation with Hasan and Verena. Miccai challenge guidelines (attached) BIAS_ReportingGuideline.pdf
PS: ideally you can separate between timings:
- medperf housekeeping
- loading model weights
- actual inference
- computing metrics
Probably I missed some relevant points.