Teacher Tools: The results incorrect when set result as N/A or Needs work and then turn on the Auto-Run

[v-katherine]

Describe the bug Teacher Tools: The results incorrect when set result as N/A or Needs work and then turn on the Auto-Run

Steps to reproduce the behavior 1.Navigate to MakeCode Teacher Tool (microbit.org) and make sure the turn off the Auto-Run. 2.Enter Project Link and submit. 3.Choose the Rubric, and switch to Results tab. 4. Change some rubrics results as N/A or Needs work. 5.Turn on Auto-Run and observe the results.

Actual behavior: The results which changed to N/A or Needs work are incorrect after turning on Auto-Run.

Expected behavior: All rubrics will be evaluated and outcome correct results.

Screen Recording:

Additional context: 1.OS: Windows11 2.makecode.microbit,org version: 7.0.6 3.Microsoft MakeCode version: 10.0.18

[v-katherine]

The results are correct when set results as N/A or Needs work and then click Run

[thsparks]

This is by design, if the teacher specifically sets a result then it gets priority. But we can chat about this as a team, since it does feel a bit inconsistent that pressing "run" does overwrite it but auto-run does not.

[abchatra]

Lets be consistent for both auto-run and run.

[eanders-ms]

Proposal:

Make Run and Auto-run status-aware After the user has manually set the status of a criteria to anything other than Not Started, Run and Auto-run will no longer evaluate that criteria. Manually setting status back to Not Started clears the flag, allowing Run and Auto-run to evaluate and re-evaluate the criteria in question.

Exception for single-criteria evaluation If the user clicks the Run button on the criteria itself (single-criteria run), then we will evaluate the criteria regardless of status.

Thoughts?

[abchatra]

Move the autorun to the right and name auto run on load.

[fionama100]

I verified this bug in the latest version:7.0.29 and it has been fixed.