reframe
reframe copied to clipboard
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.
We would like to have optional notifications sent to the maintainer of a test when the test fails. ```python @rfm.simple_test class mytest(rfm.RegressionTest): def __init__(self): super().__init__() self.descr = "A Simple test"...
I keep running in to this - I think it would be really useful if any of the accepted configuration parameters could be specified in system, partition, environment or test,...
Documentation is [here](https://docs.python.org/3.5/library/os.html#os.walk). Internal issue: https://madra.cscs.ch/scs/reframe/issues/379
Subclasses of `RegressionTest` are not allowed to use private fields for obvious reasons. However, in several other places of the framework private fields (i.e. fields starting with `_`) have more...
This will add a basic scheduler that can interact with Flux: https://github.com/flux-framework/flux-core Today is the first day I've ever used (and developed for) reframe, so I will need to ask...
I think it's better, because it allows you to look up previous runs by default.
I was setting up the `hpctestlib.microbenchmarks.gpu.shmem` test on our local cluster and encountered what I believe to be a bug in the sanity checking. The problem appeared when trying to...
This is a recurring issue. If a user tests needs to import a custom module (e.g., other tests or user libraries), ReFrame will not automatically import those. The user has...
This is a follow-up of https://github.com/reframe-hpc/reframe/issues/2577 and the comment https://github.com/reframe-hpc/reframe/pull/2578#issuecomment-1231358999 The request is to have a way to control the filename of the `filelog` output file, in order to have...
Since we support `spack` as a [module system](https://reframe-hpc.readthedocs.io/en/stable/config_reference.html#systems-.modules_system) it might be useful to be able to use more than one per system. Maybe we could extend the [module object](https://reframe-hpc.readthedocs.io/en/stable/config_reference.html#module-objects) to...