liaoxuanzhi

sorry for the late reply. i will implement this algorithm by pure keras and feedback to you as soon as possible.

i am training the pure keras version of adabelief algorithm using the small resnet18(decrease the kernel size by 2) on cifar10. according to my monitoring, from 0-36 epoch, it hits...

sorry for late report. i have done the implementation of pure keras version(keras =2.2.5,tensorflow=1.14.0). please check this [link:](https://github.com/liaoxuanzhi/adabelief) this is the initial idea of your work(without any tricks like Rectified,decouple...