Alex Ker

I changed that line and it was the same results. I think the tiny variations may be fine in this case.

@mikeizbicki thank you, the change indeed helped the contrast the highlighting more. In practice, is the squared L2 norm used more often, or the standard L2 norm will have the...

@benfig1127 The default batch_size=1 seem to lead to a steady increase in accuracy. My best model seemed to be the CNN, which achieved at best 93% accuracy after 100k samples....

@benfig1127 looks great! Glad my suggestion helped. You might want to lower the lr by a factor after each subsequent warm_start, as you get closer to the minima. @mikeizbicki Here...

The pink is with batch_size=1, blue and green is batch_size=2.

@mikeizbicki great this seems to work, I did not know we had to adjust that section of the code as well. Thank you!

Hey, this is Alex Ker. Love to chat about deep learning and feel free to visit p-ai.org!