medperf icon indicating copy to clipboard operation
medperf copied to clipboard

[FEATURE] log inference times

Open neuronflow opened this issue 2 years ago • 1 comments

Is your feature request related to a problem? Please describe. We need to know the inference times of algorithms per exam.

Describe the solution you'd like Medperf should log and return inference times in milliseconds.

Additional context Email conversation with Hasan and Verena. Miccai challenge guidelines (attached) BIAS_ReportingGuideline.pdf

neuronflow avatar Sep 28 '23 12:09 neuronflow

PS: ideally you can separate between timings:

  • medperf housekeeping
  • loading model weights
  • actual inference
  • computing metrics

Probably I missed some relevant points.

neuronflow avatar Sep 29 '23 19:09 neuronflow