Fail test instead of erroring out when not interactive or updating

[moble]

Admittedly, I don't understand all the subtleties of how people want these tests to work, so maybe this won't work for others. But for me, when a test fails in non-interactive non-updating mode, I still want to see all of the failures rather than just getting the whole testing framework to error out.

[moble]

Of course, a lot of the tests rely on an error being thrown, rather than just test failure... I'll need some guidance.