Learning rate issue

[mirakim227]

Before all, thank you for sharing this wonderful code :)

I'd like to ask why the inner loop learning rate is multiplied by 10 in the function 'update_adamax'.

As an inner loop learning rate, I put the value 1e-6 and observed that the learning rate value(which is defined as clr in the def. update_adamax') is printed to be '1e-5', not '1e-6'.

So would you please let me know why this happens? Thanks in advance!