longformer topic
List
longformer repositories
awesome-fast-attention
978
Stars
108
Forks
Watchers
list of efficient attention modules
Text-Summarization
84
Stars
6
Forks
Watchers
Abstractive and Extractive Text summarization using Transformers.
Master-Thesis-Multilingual-Longformer
31
Stars
8
Forks
Watchers
Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models cou...