Mason Chang

Results 4 issues of Mason Chang

DO NOT SUBMIT, just for visibility.

DO_NOT_MERGE

Currently only works for inference. The assumptions don't hold for training with Autograd yet.

DO NOT SUBMIT Testing and want to get benchmarks first.