domjudge icon indicating copy to clipboard operation
domjudge copied to clipboard

Multipass problem Support

Open mzuenni opened this issue 5 months ago • 7 comments

Description of the enhancement request

In multipass problems the submission gets started multiple times and is fed with the output of the output valdiator from the previous run (but besides that the new run has no knowledge of any prior run). This allows some new types of problems about information theory and some other fields.

Expected behaviour

  • The submission is run on the test input (like for normal problems)
  • The output Validator is run on the submission output (like for normal problems)
  • The output Validator either accepts, rejects or indicates that the submission should be run again with a new input that it provides

Any other information that you want to share?

Multipass seems to also get added to the kattis problem package format: https://www.kattis.com/problem-package-format/spec/2023-07-draft.html#multi-pass-validation Maybe it would also be nice to run the output validator with an argument which indicates which iteration this is or provide a way for the output validator to keep information between invocations.

mzuenni avatar Jan 24 '24 12:01 mzuenni