lookahead_pytorch
lookahead_pytorch copied to clipboard
pytorch implement of Lookahead Optimizer
Hi, as mentioned in the title, part of the model's parameters are freezer (requires_grad=False) and they are on the CPU, in this case, I got the RuntimeError on [this](https://github.com/lonePatient/lookahead_pytorch/blob/master/optimizer.py#L90) line...
When trying to save optimizer_state_dict, I get an error saying >>Lookahead has no attribute 'state' I thought this was due to not initializing parent class inside the class ```Lookahead``` and...
Could you please add a license (e.g., MIT), so I can use your code without legal troubles? :)
optimizer.step() File "/home/thomas/HELIX/superpoint-graph-job/superpointgraph2/learning/refactor/models/optimizers.py", line 33, in step group['step_counter'] += 1 KeyError: 'step_counter' Do you have any idea how it can be solved ? I would like to try it out...