Zach Forrest

If you're resuming training with your pretrained weights, try loading your weights here just before compilation like so. Worked for me! ``` optimizer = Adam(lr=0.5e-4, beta_1=0.9, beta_2=0.999, epsilon=1e-08, decay=0.0) #optimizer...

If i recall correctly, just set WARM_UP_BATCHES and you're good. You can tell its working because your loss will jump (probably up) once the warm up is complete, so just...