Ponku

@NicolasHug , yes. During inference time the momentum parameter has no effect on batch-norm as it uses the running means and variances for inference and the evaluation performance will be...

@NicolasHug, in that case yes, the appropriate `default` momentum value should be set to 0.01 and it shouldn't have any side effects (inference or fine-tuning wise).