Be more obnoxious about errors.

[jonhiggs]

"command not found" errors currently get spat out at the top of stdout and program continues, skipping the broken tests. It should either show that the tests failed, or abort the run.