pointer-generator icon indicating copy to clipboard operation
pointer-generator copied to clipboard

有用transformer做中文摘要的吗,出现了重复输出一个字的问题,考虑怎么在transformer中加上Coverage Mechanism,有做过的吗,欢迎交流q975669552

Open BlueFishDream opened this issue 5 years ago • 3 comments

BlueFishDream avatar Oct 31 '19 02:10 BlueFishDream

这样是不是需要改transformer的结构,在encoder、decoder attenttion计算中加入coverage部分(+ w_c*C_t),然后在loss中加一项covLoss?请问有方案了吗?

yuanhuachao avatar Aug 28 '20 04:08 yuanhuachao

你只用transformer做的效果大概是怎样的

---原始邮件--- 发件人: "yuanhuachao"<[email protected]> 发送时间: 2020年8月28日(周五) 中午12:26 收件人: "abisee/pointer-generator"<[email protected]>; 抄送: "Subscribed"<[email protected]>; 主题: Re: [abisee/pointer-generator] 有用transformer做中文摘要的吗,出现了重复输出一个字的问题,考虑怎么在transformer中加上Coverage Mechanism,有做过的吗,欢迎交流q975669552 (#154)

这样是不是需要改transformer的结构,在encoder、decoder attenttion计算中加入coverage部分(+ w_c*C_t),然后在loss中加一项covLoss?请问有方案了吗?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.

lipingbj avatar Aug 28 '20 04:08 lipingbj

没有尝试…

yuanhuachao avatar Aug 28 '20 06:08 yuanhuachao