reframe
reframe copied to clipboard
Allow setting existing parameters from the command line
That's a current limitation. You cannot reset a parameter from the command line. It would be nice to be able to do:
class my_test(...):
x = parameter(range(10))
reframe --parametrise my_test.x=1,4,5
and change the parameterisation of my_test
.
+1, we'd be interested in that. I'd like to have e.g. a test that by default parametrizes over all GROMACS
modules find by find_modules
. But sometimes, I may want to run the test just with one particular GROMACS
. It would be great if we can then overwrite on command line like this.
But sometimes, I may want to run the test just with one particular GROMACS
The parameterize option that @vkarak suggests would still be useful if the new values are not included in the test's parameters, but for many cases selecting the test you like with the -n
option may be enough, right?
Yes, the idea is to be able to override the parameter values completely. That's a superset of what @casparvl requests, but it would still make his scenario much faster if we supported this option. :-) Currently, also what you suggest @ekouts would work fine, and it's much more convenient now with the test hashes as that you can quickly select a test with -n /<hash>
. But you still have to pay the cost of creating all the test variants, which can be significant using the find_modules()
that interacts with the modules system.