nbgrader pass all test cases no matter it is correct or not!

[2010hexi]

I set up a simple task to test the Validation before submission, and I foud there is a bug.

Sample task as below

on the assignment tab, click the Validate button, it shows success no matter it is correct or not.

Operating system

Ubuntu 20.14

nbgrader --version

nbgrader version 0.7.0

jupyterhub --version (if used with JupyterHub)

2.0.0

jupyter notebook --version

6.4.11

Expected behavior

It should detect the fail test cases

Actual behavior

pass all the test cases no matter it is correct or not

[davidnero]

You need to enable the nbgrader toolbar ("Create Assignment") and mark the cells as "Autograder tests"

[2010hexi]

You need to enable the nbgrader toolbar ("Create Assignment") and mark the cells as "Autograder tests"

Of ofcourse, I set it.

[tuncbkose]

Have you set points for the cell to be bigger than 0? I remember encountering this myself, and I think this was the problem in my case.

If this is indeed true, I would argue this is unintuitive behavior that should be changed. It is on my to-do list for investigation/fixing, for our local fork at least. I'll make a pr if someone else doesn't fix it by then.