spatialdata icon indicating copy to clipboard operation
spatialdata copied to clipboard

User documentation on different methods of benchmarking with SpatialData

Open berombau opened this issue 1 year ago • 0 comments

Is your feature request related to a problem? Please describe. A lot of documentation is focused on one dataset or method. Method developers need to benchmark multiple datasets or methods e.g.

Benchmarking functions

  • compare two segmentation models creating a Labels element
  • compare two methods outputting a SpatialData object

Benchmarking pipelines

  • working towards larger benchmarks
  • how to benchmark on large infrastructure, HPC
  • link to openproblems.bio

Describe the solution you'd like A tutorial documentation with just text on benchmarking pointing to the right resources or documentation for each type of benchmarking method.

Describe alternatives you've considered A lot of existing material exists, but there is no overview or examples specifically using SpatialData.

Additional context Benchmarking or performance analysis for developers contributing to SpatialData is out-of-scope for this issue.

berombau avatar Nov 06 '24 15:11 berombau