benchpark
benchpark copied to clipboard
LLNL
An open collaborative repository for reproducible specifications of HPC benchmarks and cross site benchmarking environments
Given 2 runs of an experiment (same machine or different machines), what is different in: - systems (spec diff?) - build (ignore system software - compilers (+cmake etc.), mpi, math...
- [ ] Need to move compilers.yaml to packages.yaml - [ ] Need to understand when Ramble will shift to this as well, Spack expected to shift by November 2024....
Tested in openmp mode on quartz, lassen and tioga, pascal and x86 (nosite)
The usual "Here's what to do if you know what you're doing."
Make the list of systems searchable; consider using `IO500 website < https://io500.org/submissions/customize/sc23/ten-production>`_ as inspiration.
Application.py can give suggestions on where an experiment might be run, but not requirements. However, application.py could define a workload variable that can then be used in experiment variables. Example...
We'd like to have the benchpark binary be able to check the version of python in use against the minimum version, mention the minimum version in the documentation, and both...