Flesh out the predict.py validation testing code to generate precision/recall statistics, ROC curve, confusion matrix, etc. to know how training is going.

[BradNeuberg]