ashafahi

Hi, Correct. We have started with random initialization. However, starting from a pre-trained net also works. It can even increase clean validation accuracy a bit.