imagenet icon indicating copy to clipboard operation
imagenet copied to clipboard

loss didn't get down

Open chutongz opened this issue 6 years ago • 2 comments

Hi, I am using your code on both VGG and your original alexnet networks. The way I manage my data is exact following your instructions, and I tried to use np_util.to_categorial() function instead, but the loss is always around 8 even after 100+ epochs, and 16 on the original code. Do you have any idea what's the probable problem of it? Any help is appreciated, thanks a lot!

chutongz avatar Oct 09 '18 03:10 chutongz

Hi @chutongz have you already tried to lower the learning rate? Like to 1e-4?

matteo-dunnhofer avatar Oct 10 '18 13:10 matteo-dunnhofer

@dontfollowmeimcrazy i do have the same situation with your posted code. If learning rate is set to 1e-2 the loss drop logically, while after 1 epoch the loss saturate and no longer drop. May i ask what is the final settings for a workable training?

briansune avatar Jan 02 '19 13:01 briansune