how about using gpt2 as encoder and decoder?

[hanqi-qi]

Hi! Great work. But one open question :D

I am curious about the performance of using gpt2 as both encoder and decoder? I am not sure if the discrepancy from different tokenization can result in performance degradation.

Thanks

[ChunyuanLI]

Did you build the model using gpt2 as both encoder and decoder? I believe it is possible, but don't know how it performs. Would be interested if you trained it. Thanks.