enas icon indicating copy to clipboard operation
enas copied to clipboard

I have read the enas paper,which says that weight sharing is used for efficiency. Any one can tell me which part of the code realize the weight sharing?Thanks a lot!

Open berisfu opened this issue 5 years ago • 4 comments

I have read the enas paper,which says that weight sharing is used for efficiency. Any one can tell me which part of the code realize the weight sharing?

berisfu avatar May 11 '19 11:05 berisfu

Hi, ENAS builds a DAG to achieve weight sharing. The DAG is created in this file. https://github.com/melodyguan/enas/blob/master/src/cifar10/general_child.py

AlanChou avatar May 11 '19 11:05 AlanChou

Hi, ENAS builds a DAG to achieve weight sharing. The DAG is created in this file. https://github.com/melodyguan/enas/blob/master/src/cifar10/general_child.py

I also have view the ENAS Keras implementation whose url is as here https://github.com/shibuiwilliam/ENAS-Keras/blob/master/ENAS.py. they use CNC.set_weight_to_layer(save_to_disk=self.save_to_disk) to save the weight file, use CNC.fetch_layer_weight(save_to_disk=self.save_to_disk) to load the weight. Via this method,they realize the weight sharing,finally get best efficiency NAS. I am pretty new to tensorflow,I have read the official code,but can not find out which part of the code realizes the weight saving and weight loading.

berisfu avatar May 11 '19 12:05 berisfu

anybody can help me?Thanks a lot!

berisfu avatar May 11 '19 13:05 berisfu

@berisfu its where the reuse=reuse comes in. within the variablescope under ("child") all train, val, test graph use the same parameters.

matthewygf avatar Jul 02 '19 14:07 matthewygf