reframe
reframe copied to clipboard
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.
Currently, references are indexed by the system and/or partition name. This is insufficient as many times the references do not depend on the system partition per se, but rather partition...
Support combining `valid_systems` and `valid_prog_environs` constraints from base `RegressionMixin`s
The `RegressionMixin` is used for extending the functionality of existing tests, thus the more accurate name of "plugin". The plan is for 4.9 to deprecate the `RegressionMixin` name in favor...
We would like to configure a time limit for an entire ReFrame run. If this time limit is reached, ReFrame should gracefully terminate all running tests and generate the JSON...
Although when the updated logging was introduced in 4.0 we thought that this would be sort of "compatibility" mode, I think it's still valid and widely used. Therefore, I suggest...
If many session extras are stored with `--session-extras` then the default output can be too wide.
Currently, we don't check the schema of the results when loading from the database, but we do check it when trying to restore a session. We should generally disable loading...
This is a follow up from #3402. Copying here the detailed explanation: > not all configuration options have an effect at partition level, since many of them affect global aspects,...
Sometime we may want a test to pass but give a warning. I am thinking that it would be nice to add a workaround warning for tests with a “temporary”...
That allows to perform tasks even if the test has failed and before exiting. It is related to #2671.