benchpark
benchpark copied to clipboard
Benchpark Rewrite Roadmap
- [x] System init, docs. #298 - merging 8/19
- [x] Experiment init, docs. #331 @alecbcs @becker33 - merge before 8/22
- [ ] Re-create all existing LC systems (manual checking) - start 8/22
- [ ] Re-create all existing experiments (manual checking) - start 8/22
(feature parity here)
- [ ] Add dry run test for new experiments and new systems. #343 @alecbcs @scheibelp
- [ ] Enable Caliper modifiers with our new experiments. #352 @rfhaque
- [ ] Add equivalence test for experiments #353 @becker33
- [ ] Make progress on spack diff #354 @scheibelp
- [ ] Workflow docs (aspirational to start and keep us on track). #333 @dyokelson @alecbcs
- [ ] Unifying command to generate a workspace (tied with workflow docs) #336 This is to support the next item
- [ ] Implement compatibility checking between system (provides cuda) and experiment (requires cuda). Design 8/26
Allows
Experiment
s to assume they have a compatibleSystem
for all initialization methodsSystem
s defineprovides
andExperiment
s definerequires
Compatibility information is consumed by concretizer forExperimentSpec
- [ ] Break cmds into their own files. (Spackify the lib/ structure.) @becker33
- [ ] System create, docs (with a template like
spack create foo
) - [ ] Experiment create, docs (with a template
spack create foo
) - [ ] Mechanism to pass Benchpark and Ramble variables to Caliper #355 @dyokelson