optimade-python-tools icon indicating copy to clipboard operation
optimade-python-tools copied to clipboard

Randomness in the validator

Open ml-evs opened this issue 3 years ago • 2 comments

From discussion with @markus1978

ml-evs avatar Jun 07 '21 18:06 ml-evs

A parameter that allows to fix formulas, queries, ids that are usually taken from the first page of results would allow to make the validator outcome deterministic.

On the other extreme, if the validator could go through many randomly selected pages, entries, queries for a long time, we could use this to find lots of otherwise hard to find error states.

markus1978 avatar Jun 07 '21 19:06 markus1978

This could be fixed by introducing a command line parameter to set a fixed seed for randomization. I see the use of reproducible validator runs.

merkys avatar Jun 13 '24 19:06 merkys