Add Attention to the classification models

[TharinduDR]

Thank you for the wonderful repo and tutorials. Do you have an implementation to add attention to the classification models with torchtext?

[bentrevett]

If you know of any papers/models that have an attention based model for sequence classification, let me know and I can look into adding those. Usually attention is used for sequence-to-sequence learning, and I have some tutorials on that which use attention, see: https://github.com/bentrevett/pytorch-seq2seq tutorials 3 onwards.

[anuraggoel70]

https://arxiv.org/pdf/1409.0473.pdf

[bentrevett]

That model is for sequence-to-sequence learning, not sequence classification.

[TharinduDR]

Hi @bentrevett Was just checking on the issue - people have used it for many Kaggle competitions commonly. One such example is this - https://www.kaggle.com/hung96ad/pytorch-starter

[bentrevett]

Thanks for the link. Will check it out.

[karan121bhukar]

i want to work on this issue, is it still open?