Wavelet-like-Auto-Encoder icon indicating copy to clipboard operation
Wavelet-like-Auto-Encoder copied to clipboard

What's the structure of decoding layer

Open BoyuanYan opened this issue 7 years ago • 3 comments

I could extract the encoding layer on stage 1, but there isn't enough information about decoding layer structure. I've tried the symmetrical structure of encoding layer which contains only one BN after deconv. However, I'm not sure if it is correct. The image reconstruction after 1 epoch shows that high-freq image is likely all-dark, and loss decreases to 131.449 from 10000, which are confusing.

BoyuanYan avatar Jan 15 '18 09:01 BoyuanYan

We have presented the detailed structure of the encoding and decoding layers in our paper. Please read our paper for more details.

tianshuichen avatar Jan 15 '18 09:01 tianshuichen

Sorry about reading your paper roughly, and I'll read it in detail later. However, there are still two little questions. I'll be appreciated very much for any reply.

  1. Is BN always applied after conv/deconv in encoding and decoding layer?
  2. How many epochs on stage 1?

BoyuanYan avatar Jan 15 '18 09:01 BoyuanYan

We do not use BN after convolutional layers of the WAE. We merely use one BN layer when feeding the decomposed sub-image into the classification network.

We train the WAE about 20 epoches on the ImageNet dataset.

tianshuichen avatar Jan 15 '18 12:01 tianshuichen