reframe
reframe copied to clipboard
reframe-hpc
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.
It would be useful to be able to run tests only on specific partitions of a system, based on a regex. This would be similar to selecting certain test names...
If a test suite runs for too long, in case of single test failure, there is only a single line being printed describing in which stage the test has failed...
currently, combining `sysname:partname` with features is not fully supported in ReFrame (tested in v4.0.5) for example, this works (multiple list items behave like the OR operation): ``` valid_partitions = ['*:ampere',...
Currently, this is not possible and there exist multiple options, especially in `systems`, `partitions` and `environments` that can only be set from the configuration file. It would be nice to...
The `-t` option (and inverse `-T` for exclusion) stacks with multiple uses. For example, `-t OSU -t NBC` could be used to run just nonblocking collectives from the OSU MPI...
It would sometimes be useful to be able to exclude specific system:partition's from a generic run. For instance running a test which has "valid_systems = ['+gpu']" but excluding specific gpu...
hpctestlib/microbenchmarks/gpu/memory_bandwidth should pick up gpu_build the same way gpu_burn does
gpu_burn does: ``` if self.gpu_build is None: # Try to set the build type from the partition features if 'cuda' in curr_env.features: self.gpu_build = 'cuda' elif 'hip' in curr_env.features: self.gpu_build...
We could print that in a sort of detailed listing or with a new option, so that users can easily check what their test variables and parameters mean.
It would very convenient to be able to write something like this: ```python class my_test(...): x = variable(SINumber(unit='s'), value='5us') ``` And also be able to set this from the command...
Metadata
Owner
Metadata
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.