dorado icon indicating copy to clipboard operation
dorado copied to clipboard

Request: Document GPU Performance in a Table

Open Kirk3gaard opened this issue 1 year ago • 4 comments

To determine which GPUs people need for their projects it would be great to have some benchmarks for the GPUs that you test dorado on. If you expand the table you already have with some values for the amount of data that can be basecalled/hour or something that would be really helpful.

Platform GPU/CPU Minimum Software Requirements fast (Gbp/hour) hac (Gbp/hour) sup (Gbp/hour) sup all mods (Gbp/hour)
Linux x86_64 (G)V100 CUDA Driver ≥450.80.02
A100 CUDA Driver ≥450.80.02
H100 CUDA Driver ≥520
Linux arm64 Jetson Orin Linux for Tegra ≥34.1.1
Windows x86_64 (G)V100 CUDA Driver ≥452.39
A100 CUDA Driver ≥452.39
H100 CUDA Driver ≥520
Apple Apple Silicon (M1)
Apple Silicon (M2)

Kirk3gaard avatar Nov 21 '24 08:11 Kirk3gaard

The reference to the old benchmarks indicate that it is somewhat outdated (dorado 0.3.0)) and no H100. https://aws.amazon.com/blogs/hpc/benchmarking-the-oxford-nanopore-technologies-basecallers-on-aws/

Kirk3gaard avatar Nov 21 '24 08:11 Kirk3gaard

I would add that it would be incredibly helpful to also include top-end consumer cards, like the RTX 4090. Often these are the most cost effective based on their performance.

mcrone avatar Nov 22 '24 13:11 mcrone

Perhaps if you make a benchmarking protocol, people can run it and post the results. I'd be happy to run it on all of our machines.

James

Psy-Fer avatar Nov 22 '24 13:11 Psy-Fer

How about we derive a benchmark using that data? https://nanoporetech.com/document/telomere-to-telomere-sequencing-t2t-on-promethion-sqk-apk114-sqk#downstream-analysis

ChristianKniep avatar Dec 19 '24 10:12 ChristianKniep