reframe icon indicating copy to clipboard operation
reframe copied to clipboard

Allow setting existing parameters from the command line

Open vkarak opened this issue 2 years ago • 3 comments

That's a current limitation. You cannot reset a parameter from the command line. It would be nice to be able to do:

class my_test(...):
    x = parameter(range(10))
reframe --parametrise my_test.x=1,4,5

and change the parameterisation of my_test.

vkarak avatar Nov 17 '22 23:11 vkarak

+1, we'd be interested in that. I'd like to have e.g. a test that by default parametrizes over all GROMACS modules find by find_modules. But sometimes, I may want to run the test just with one particular GROMACS. It would be great if we can then overwrite on command line like this.

casparvl avatar Nov 24 '22 11:11 casparvl

But sometimes, I may want to run the test just with one particular GROMACS

The parameterize option that @vkarak suggests would still be useful if the new values are not included in the test's parameters, but for many cases selecting the test you like with the -n option may be enough, right?

ekouts avatar Nov 24 '22 11:11 ekouts

Yes, the idea is to be able to override the parameter values completely. That's a superset of what @casparvl requests, but it would still make his scenario much faster if we supported this option. :-) Currently, also what you suggest @ekouts would work fine, and it's much more convenient now with the test hashes as that you can quickly select a test with -n /<hash>. But you still have to pay the cost of creating all the test variants, which can be significant using the find_modules() that interacts with the modules system.

vkarak avatar Nov 24 '22 15:11 vkarak