Dylan Green

Well if we want to cover all our bases we have to collect all Adam variants. In the appendix to the aforementioned AdamW paper they propose a further variant AdamR...

@mratsim I'm curious about adding momentum to SGD (largely to avoid doing any actual work in my own Nim projects, ha). Would you want to do it in the same...

I quite like this player so am happy to help out here if I can, but for me it is only the arm build that is broken. I have an...