reframe
reframe copied to clipboard
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.
Flexible tests fail if the number of idle nodes are greater than the workload manager's imposed limit on the queue. An example using SLURM is Consider the following SLURM config...
It would be nice if ReFrame could generate the basic skeleton of a test from the command line, e.g: ``` reframe --generate 'MyTest' ``` would generate the python file with...
What about replacing the `-l/-L`, `-r` and soon `--ci-generate` options with commands? ``` reframe list ``` ``` reframe list --detailed ``` ``` reframe run [OPTIONS] ``` ``` reframe ci-generate ```
Sometimes tests fail but their retry passes. It would be nice if ReFrame could display the node list of the failed tests even if their retry passes. The optimal would...
Currently when a test run completes, `reframe` doesn't give much information, just a single line like: ``` [ PASSED ] Ran 717 test case(s) from 717 check(s) (0 failure(s)) [==========]...
There are several parameters controlling the behaviour of the scheduler backends, which now are just internal. The idea is to expose them as configuration parameters that the user can control....
Currently, the poll rate control is only available for the async policy and it is hidden and non-configurable from the users. The purpose of this issue is twofold: 1. Create...
The unit tests are not covering sufficiently `cli.py`. We should add more tests to improve the coverage.