Abstractive-Summarization-With-Transfer-Learning icon indicating copy to clipboard operation
Abstractive-Summarization-With-Transfer-Learning copied to clipboard

decoder embedding

Open xiongma opened this issue 6 years ago • 1 comments

@santhoshkolloju when you train this model, do you use bert embedding as abstract embedding, it mean article and abstract will go through bert when train this summary model?

xiongma avatar May 08 '19 10:05 xiongma

Yes that's correct we use the same weights of Bert embedding at the decoder prediction layer as well

santhoshkolloju avatar May 22 '19 15:05 santhoshkolloju