darts icon indicating copy to clipboard operation
darts copied to clipboard

Architecture parameter initialization

Open JaminFong opened this issue 6 years ago • 1 comments

https://github.com/quark0/darts/blob/f276dd346a09ae3160f8e3aca5c7b193fda1da37/cnn/model_search.py#L123 Hi, quark. I noticed that the architecture parameters are multiplied by 1e-3 when being initialized. Could you please explain the reason for this initialization manner? Thanks!

JaminFong avatar Apr 11 '19 11:04 JaminFong

I've also noticed this point. Probably it is just a random pick. You may try with other initialization such as Xavier etc.

Let me know if you try with different initialization.

Catosine avatar May 30 '19 04:05 Catosine