reframe

reframe copied to clipboard

This could help catch regressions like the one in https://github.com/eth-cscs/reframe/issues/2466

teojgo

Provide more accurate timings for the different test phases

1

Now that #1402 is merged, we should have more room to accommodate more frequent status updates and therefore get more accurate timings.

vkarak

The current test syntax allows to define variables as strings and these are implicitly converted to a special type of a backend. An example is the `build_system` variable where users...

vkarak

auto-detection, use existing module if told to

2

The auto-detection could perhaps be made to use an existing module on the remote system instead of bootstrapping itself. I would make the process a lot faster. A config option...

akesandgren

Investigate better ways for storing the resources of regression tests

9

The current way of storing resources in an external directory is not good, because the files are untracked. Sharing them is not easy either. We should find a different and...

vkarak

For example, the `variables` field. We now require it to be of type `dict[str, str]`, but in fact any type of values could be used, since the `str()` is called...

vkarak

Consider dropping support of Python 3.6

2

We need to identify the places in the code where we have workarounds needed for Python 3.6. If we move to Python 3.7, we are also guaranteed that dictionaries are...

vkarak

ReFrame logo in README does not show up correctly in Github's dark mode

2

Screenshot:  Thanks @branfosj for spotting this.

vkarak

Various performance log handlers in the framework are already capable of sending the full test data, but this is not enough, because it doesn't have all the information needed, neither...

vkarak

Add an argument to `--flex-alloc-nodes` option that will allow you to select only the nodes that are up

3

Currently, the `all` argument selects all the nodes in the system partition that fulfil any additional constraints placed from the command line. We also have the `STATE` argument that allows...

vkarak