benchpark icon indicating copy to clipboard operation
benchpark copied to clipboard

Add a dry run test for our new experiments and systems

Open pearce8 opened this issue 6 months ago • 0 comments

Updated:

  • [X] @scheibelp implemented an instantiation of a system which benchpark setup can use.
  • [x] @scheibelp, please implement a way to instantiate an experiment which benchpark setup can use.

It would be good to have an equivalent to Ramble dryrun we are using in .github/run.yaml that we can use to test validity of variables we are passing into Ramble. It may be the "experiment init" followed by the test below with a system description we know works (or a "system init" followed by a dry run of known working experiment):

  - name: Dry run amg2023/openmp on Dane with allocation modifier
    run: |
      ./bin/benchpark setup amg2023/openmp LLNL-Dane-DELL-sapphirerapids-OmniPath workspace/
      . workspace/setup.sh
      ramble \
        --workspace-dir workspace/amg2023/openmp/LLNL-Dane-DELL-sapphirerapids-OmniPath/workspace \
        --disable-progress-bar \
        --disable-logger \
        workspace setup --dry-run

pearce8 avatar Aug 22 '24 23:08 pearce8