reframe
reframe copied to clipboard
reframe-hpc
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.
[In the documentation](https://reframe-hpc.readthedocs.io/en/stable/tutorial.html#multiple-job-steps), the `prepare_cmds` are associated with the partition and it is possible to add them in the config file. It should be possible to define something like `self.prepare_cmds`...
Version: 4.8.1 While using the `local` scheduler, the `jobid` entries of the report file are an integer instead of a string. This was not happening in version 4.6.x.
It only shows the system and not the partition's name. ```bash ./bin/reframe -c unittests/resources/checks/frontend_checks.py -n ^PerformanceFailureCheck -r ``` In failure info: ```console * System partition: generic ``` Instead of showing...
We should also add a tip that if you are writing a library it's a wise idea to properly make the names unique by following a pattern `__`. This will...
This would extend the behaviour to distribute the corresponding tests in a particular number of nodes, randomly selected among the ones that "pass" the different job scheduler criteria and /...
If the `descr` field is set properly in the test, this will give more insight as of what the test's purpose is. CC: @gppezzi
Currently we are using the `http_logger` to send performance results to elastic through Reframe. It would be nice to be able to send in a similar format the results of...
At the moment ReFrame makes the assumption that CMake will generate standard `UNIX makefiles`. We can generalize the behaviour by using build-generator agnostic commands: ``` cmake -B -S cmake --build...
Currently, only a single aggregation is supported, meaning that to obtain the three currently available stats (min, max, mean), users have to run the `--list-stored-testcases` three times. This is inefficient...
The build tool in `CMake` build is hardcoded to `make`: https://github.com/reframe-hpc/reframe/blob/cb4a2ac751c0f19637d735e4009dd20518d3a2af/reframe/core/buildsystems.py#L603 Can this be made user configurable?
Metadata
Owner
Metadata
A powerful Python framework for writing and running portable regression tests and benchmarks for HPC systems.