apex
apex copied to clipboard
Add set_to_none keyword parameter to Optimizer's zero_grad
Starting with the 1.7.0 release Pytorch has added set_to_none
keyword to Optimizer's zero_grad method. It seems apex optimizers already implement this functionality but it would be great if they respected this updated signature as well.