blocks icon indicating copy to clipboard operation
blocks copied to clipboard

Published 20 hours ago • verified publisher icon mila-iqia

Glorot/Bengio initialization

Open vikkamath opened this issue 9 years ago • 4 comments

I use the so called 'Xavier' initialization in a lot of my work and was wondering if implementing it as a part of blocks.initialization would be of any use.

vikkamath avatar Apr 03 '15 10:04 vikkamath

To make sure we think about the same initialization scheme, could you please give a link to the paper?

rizar avatar Apr 03 '15 11:04 rizar

Understanding the Difficulty of Training Deep Feedforward Networks

vikkamath avatar Apr 03 '15 11:04 vikkamath

Okay, I see. I think it would be nice to have it in Blocks.

rizar avatar Apr 03 '15 11:04 rizar

Okay, thanks! I'll work towards submitting a PR in a few days.

vikkamath avatar Apr 03 '15 12:04 vikkamath