lightweight-neural-architecture-search icon indicating copy to clipboard operation
lightweight-neural-architecture-search copied to clipboard

Published 20 hours ago • verified publisher icon alibaba

[DeepMAD] question about the entropy compute

Open Yuxinyi-Qiyu opened this issue 1 year ago • 0 comments

hey, in code 'get_deepmad_forward' func, the deepmad compute way is log(sqrt(c*k^2/g)), [https://github.com/alibaba/lightweight-neural-architecture-search/blob/main/tinynas/models/blocks_cnn_2d/blocks_basic.py#L444]

but in paper, the definition of the CNN entropy is without sqrt option, image

Yuxinyi-Qiyu avatar Jun 15 '24 05:06 Yuxinyi-Qiyu