Lack of bias and batch normalization?

[laoreja]

As is described. I also wonder if there is some standard for computing number of flops. Say, flops usually count the number of multiplication and addition, so sometimes people don’t count the comparison operation in RELU. Also set things to zero is much faster from computer architecture perspective, so sometimes people just ignore RELU. Anyway, thanks for the clear code!