reframe

reframe copied to clipboard

Since we only have `simple_test` as the only valid decorator for registering tests, it would be better to use a better name for the decorator.

teojgo

Issue a more specific error when a fixture of a test fails

1

Currently, the parent test will simply fail with a `DependencyError`, whereas we could also point out the failing fixture.

vkarak

The reason we treat differently environments and partitions (aka systems) is that systems define the basic configuration scopes (not to be confused with the scopes requested in #1725). For example,...

vkarak

For example, the `user_exec_ctx` and the `remote_exec_ctx` could be candidates.

vkarak

Add a pipeline stage that is executed independently of the build/run result

1

This would be useful if we need to do some cleanup action regardless of the build/run status. E.g remove some temporary directory created outside of the stage dir.

teojgo

Replace variables with env_vars

1

jjotero

We can get inspiration from what we've done for the A-HUG AWS hackathon.

vkarak

Add a "Migrating to 4.0" guide in the documentation

1

ReFrame 4.0 will bring a set of fundamental changes in the syntax. This guide should provide guidance on migrating from ReFrame 3.x series. Meanwhile, the framework will be issuing deprecation...

vkarak

Allow multiple perf_patterns on one line in handlers_perflog

3

When specifying multiple entries in perf_patterns (for instance as in cscs-checks/microbenchmarks/mpi/halo_exchange/halo_cell_exchange.py), every performance variable is put on a separate line by the logging handler. All attributes that are not related...

stevenvdb

Support file patterns in the `readonly_files` attribute

3

Internal issue: https://madra.cscs.ch/scs/reframe/issues/254

vkarak