Obojobo icon indicating copy to clipboard operation
Obojobo copied to clipboard

Partial scoring for pick-all questions

Open jpeterson976 opened this issue 2 years ago • 3 comments

Resolves #545

MC questions that are pick-all should now calculate their scores based on how many correct/incorrect options were chosen, instead of being all-or-nothing.

jpeterson976 avatar Aug 01 '22 17:08 jpeterson976

While I see this as a clear improvement, it does change the way assessments are graded which could have unintended consequences on grade review.

For example if a student took an assessment before this update and got no credit for a 'select all that apply' question, then go back to review that assessment score after this update goes into effect, do they still see the 0% for that question, or does the partial credit calculation say they should have received credit? I also assume this means if a student in the above situation goes to an assessment where before they lost points on select-all questions and answers those questions the exact same way, they'd end up getting more points than their previous attempts.

I can also imagine a scenario where authors want a multi-select question that specifically grants a 0% if the student does not select all possible correct answers. Is that readily possible? If not, MC questions would need some kind of a toggle which defaults to the old behavior so everything stays backwards compatible.

FrenjaminBanklin avatar Aug 01 '22 18:08 FrenjaminBanklin

It looks like previous attempt scores are correctly showing 0% for a partially incorrect question, if the assessment was taken without partial scores.

That's a good point about allowing authors to choose whether they want partial scoring or not though, I'll work on adding a toggle for it.

jpeterson976 avatar Aug 02 '22 17:08 jpeterson976

I spent some time creating different scenarios in assessments and manually checking the math of the score and it looks good. I didn't find any issues with the scoring.

RachelDau avatar Jan 31 '24 16:01 RachelDau