reframe

reframe copied to clipboard

Support injection of scheduler options from an environment

1

The concept that was discussed is the support of the following: ``` environs = [{ 'name': 'gnu', 'sched_bind_options': ['--uenv-file={env.extras["uenv_file"]}', '--uenv-mount={env.extras["uenv_mount"]'] }] ``` Using the above syntax, the `env` refers to...

teojgo

Currently `--restore-session` does not work with automatically generated tests (e.g. those created by using the `--repeat`, `--distribute` or `--parameterize` flags). Following comments under #3072, this issue is a feature request...

mirenradia

Enable running some commands before the bootstrap, similar to `prerun_cmds` in regular tests

2

The current job generated by the remote CPU detection script is: ``` #!/bin/bash #SBATCH --job-name="rfm-detect-job" #SBATCH --ntasks=1 #SBATCH --output=rfm-detect-job.out #SBATCH --error=rfm-detect-job.err _onerror() { exitcode=$? echo "-reframe: command \`$BASH_COMMAND' failed (exit...

casparvl

We already use the registry for some of the images that we use in our CI, but I think we should also publish ready to use images with the latest...

vkarak

Currently, this is not possible. The subclass must redefine the fixture and set the variable in its argument. Also, setting the variable in the fixture proxy object prior the setup...

vkarak

Case study of hpctestlib generalization (application focus)

2

Idea: - Extend the gromacs test library test using features/extras - Identify the different run scenarios - Identify the gaps between what can be achieved currently, what would be ideal

vkarak

[testlib] Add trivy scan hpctestlib

2

The test scans the file systems using aquasecurity/triyv (https://github.com/aquasecurity/trivy) The test uses the fs option and test against three different scanners vuln, config, and secret.

victorusu

[testlib] Add ssh_audit test to hpctestlist

2

The test downloads the ssh-audit tool from GitHub and checks if there is any configuration that is considered as a failure. The test is compatible with all the job schedulers....

victorusu

Allow setting existing parameters from the command line

5

That's a current limitation. You cannot reset a parameter from the command line. It would be nice to be able to do: ```python class my_test(...): x = parameter(range(10)) ``` ```...

vkarak

We could start with auto-generating the current system's partitions by inspecting basic system features and exploring the Slurm partitions.

vkarak