reframe

reframe copied to clipboard

We could introduce a new CLI that uses subcommands: `reframe ACTION [options]`, such as `reframe list` `reframe run` ...

vkarak

On the platforms where cross compilation is not possible, ReFrame provides the user with `build_locally` parameter that can be defined within a regression test. It would be helpful if we...

mahendrapaipuri

The current topology info extracted by ReFrame can be extended further to include - Memory info (Linux commands like `free` or `psutil`) - Network adapter info (From `/sys/class/net` which includes...

mahendrapaipuri

Auto-detect GPU devices

2

This is also mentioned in https://github.com/archspec/archspec/issues/25 but we could start working on a solution for ReFrame already.

vkarak

auto-detection could pick up things like clock freq and core features (sse/avx etc)

1

It could be useful for things like adapting performance reference values, and compile time options.

akesandgren

Currently we through a `ReframeSyntaxError` without any source code information associated, so this is not so user friendly. See also #2240 and #2302.

vkarak

vkarak

Exit with a non-zero code in case of failures during test loading

1

This exit code should not be the same as with the normal failures. Generally, we should come up with different exit codes for the different types of failures. One possible...

vkarak

Support marking a test as an expected failure

4

vkarak

vkarak