Manually graded answers

[cogumbreiro]

Hi,

Is it possible to have some questions/answers that are manually graded at a later time by a person?

Thanks for your time!

[Drumor]

You probably talk about replay feature? This allows you to replay submissions after modification of the run file and stuff like that.

[anthonygego]

@Drumor Answers that a human can review I guess.

Currently this is not possible. You're not the first one asking for this and I think @GuillaumeDerval took that into consideration while working on a new backend (grading steps in order to use different environments and possibly a manual grading). However, that work is not finished yet and, once it is done, the frontend would have to be modified accordingly. So I can't do any promise on when that feature would be available now.

[cogumbreiro]

Thank you @Drumor and @anthonygego for the prompt replies.

@Drumor , it's good to know that this feature is being considered.

I currently have two use cases for human reviewed answers.

In one, we want check things like if an algorithm is proceeding by recursion or iteration, where an automatic analysis can be inconclusive. As a workaround, I guess I can use INGInious as an automated validity/test checker and then manually go through the student's final submissions for the final grade.

Another use case we have is questions with free-text answers.

[GuillaumeDerval]

Another is peer-reviewing. As @anthonygego said, I indeed took these use-cases into account while developing the new version of the backend. I will eventually find time to finish it (or one of our students) :-)