unilm icon indicating copy to clipboard operation
unilm copied to clipboard

The output channel of the decoder

Open Bingchao-Zhao opened this issue 3 years ago • 2 comments

Hi I'm confused why the output channel of the decoder is twice the encoder input? Thanks for your time.

Bingchao-Zhao avatar Dec 01 '22 13:12 Bingchao-Zhao

Hi. Could you specify the Architecture you are referring here or point out the files you are locking at.

empransoumya avatar Dec 03 '22 03:12 empransoumya

Hi. Could you specify the Architecture you are referring here or point out the files you are locking at.

File: 'dall_e.decoder.py'. The output channels of the last layer of the decoder are '2 * self.output_channels'. why not 'self.output_channels'?

Thanks!

Bingchao-Zhao avatar Dec 03 '22 03:12 Bingchao-Zhao