awd-lstm-lm icon indicating copy to clipboard operation
awd-lstm-lm copied to clipboard

Published 20 hours ago • verified publisher icon salesforce

Attention Model

Open mocialov opened this issue 7 years ago • 1 comments

Any ideas on how to incorporate attention model from http://pytorch.org/tutorials/intermediate/seq2seq_translation_tutorial.html ?

mocialov avatar Feb 25 '18 16:02 mocialov

Every PyTorch implementation of the attention model I have come across uses encoder-decoder architecture adds attention model to the decoder. Is it possible to have attention in your implementation?

mocialov avatar Mar 02 '18 23:03 mocialov