lightseq icon indicating copy to clipboard operation
lightseq copied to clipboard

Can I get attention weights from lightseq?

Open King-Hell opened this issue 3 years ago • 1 comments

For some reasons, I need attention weights from the last decoder layer to implement point network or copy mechanism. It seems that only by modifying cpp files can I get those. Perhaps you may support for outputing attention weights in future?

King-Hell avatar Dec 30 '21 04:12 King-Hell

That's a good point, we'll consider to support.

Taka152 avatar Jan 04 '22 09:01 Taka152