attention-heads topic
List
attention-heads repositories
the-story-of-heads
282
Stars
44
Forks
Watchers
This is a repository with the code for the ACL 2019 paper "Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned" and the ACL 2021 paper "Analyzing Source...
