benchpark
benchpark copied to clipboard
Add a dry run test for our new experiments and systems
Updated:
- [X] @scheibelp implemented an instantiation of a system which
benchpark setup
can use. - [x] @scheibelp, please implement a way to instantiate an experiment which
benchpark setup
can use.
It would be good to have an equivalent to Ramble dryrun we are using in .github/run.yaml that we can use to test validity of variables we are passing into Ramble. It may be the "experiment init" followed by the test below with a system description we know works (or a "system init" followed by a dry run of known working experiment):
- name: Dry run amg2023/openmp on Dane with allocation modifier
run: |
./bin/benchpark setup amg2023/openmp LLNL-Dane-DELL-sapphirerapids-OmniPath workspace/
. workspace/setup.sh
ramble \
--workspace-dir workspace/amg2023/openmp/LLNL-Dane-DELL-sapphirerapids-OmniPath/workspace \
--disable-progress-bar \
--disable-logger \
workspace setup --dry-run