corrigeExamFront icon indicating copy to clipboard operation
corrigeExamFront copied to clipboard

Multiple choice grading (QCM) answer options with the annotated template are not consistently applied during grading

Open sderrien opened this issue 1 year ago • 4 comments

The annotated question template

image

The grading choice corresponding to Q3 shows options that are not present in the template (.

image

More broadly, is it expected that changes in the answer regex be immediately applied to the grading at hand ?

sderrien avatar Jan 08 '24 12:01 sderrien

The best for QCM is to select for a first try just the place where you get the square.

You can enlarge it later before sending result to student.

barais avatar Jan 08 '24 12:01 barais

My description was probably not very clear. The problem is that I observe choices (c, e, d, a & e) for grading for which I have no idea where they come from (on the template, I only allow one valid expression (c) )

sderrien avatar Jan 08 '24 22:01 sderrien

Yes, your description was clear. But it means that in analysing the template, the qcm algo found 5 square (that is why it could be a good idea to reduce the search space for square in creating a smaller zone, you could increase it later).

The qcm algo is simple: 1: search square in template from question zone. 2: search empty square in scan for the zone where it detect square in template 3: perform a new alignment based on the match of void square. 4: compare the density of the square zones in the scan for each copy. 5: send the answer.

That is why, if it creates a 'e' comment. It means that it detect 5 squares

Regards

Olivier

barais avatar Jan 09 '24 10:01 barais

OK, now I get it.

Then I have two suggestions :

  • (optionnally) ask the user to specify the number of distinct check-boxes to allow early detection of inconsistencies in the template.
  • an option during the grading process to "enlarge" by 20% the answer area to accommodate with poorly aligned scans (I agree one can switch to the whole page but this can be cumbersome)

Regards,

Steven

sderrien avatar Jan 10 '24 07:01 sderrien