GPipe Schedule hangs when run with 1 microbatch

[wconstab]

I'm assuming (but didn't debug) - because of using 1 microbatch, there is some corner case that makes the schedule hang.

Repro: https://gist.github.com/wconstab/365aa5615270645c11658e28f8051e54