benchpark icon indicating copy to clipboard operation
benchpark copied to clipboard

Benchpark Rewrite Roadmap

Open pearce8 opened this issue 6 months ago • 0 comments

  • [x] System init, docs. #298 - merging 8/19
  • [x] Experiment init, docs. #331 @alecbcs @becker33 - merge before 8/22
  • [ ] Re-create all existing LC systems (manual checking) - start 8/22
  • [ ] Re-create all existing experiments (manual checking) - start 8/22

(feature parity here)

  • [ ] Add dry run test for new experiments and new systems. #343 @alecbcs @scheibelp
  • [ ] Enable Caliper modifiers with our new experiments. #352 @rfhaque
  • [ ] Add equivalence test for experiments #353 @becker33
  • [ ] Make progress on spack diff #354 @scheibelp
  • [ ] Workflow docs (aspirational to start and keep us on track). #333 @dyokelson @alecbcs
  • [ ] Unifying command to generate a workspace (tied with workflow docs) #336 This is to support the next item
  • [ ] Implement compatibility checking between system (provides cuda) and experiment (requires cuda). Design 8/26 Allows Experiments to assume they have a compatible System for all initialization methods Systems define provides and Experiments define requires Compatibility information is consumed by concretizer for ExperimentSpec
  • [ ] Break cmds into their own files. (Spackify the lib/ structure.) @becker33
  • [ ] System create, docs (with a template like spack create foo)
  • [ ] Experiment create, docs (with a template spack create foo)
  • [ ] Mechanism to pass Benchpark and Ramble variables to Caliper #355 @dyokelson

pearce8 avatar Aug 13 '24 22:08 pearce8