multi-head-attention topic

Deep Xi: A deep learning approach to a priori SNR estimation implemented in TensorFlow 2/Keras. For speech enhancement and robust ASR.

anicolson

[VLDB'22] Anomaly Detection using Transformers, self-conditioning and adversarial training.

imperial-qore

Exploring attention weights in transformer-based models with linguistic knowledge.

poloclub

PyTorch implementation of some attentions for Deep Learning Researchers.

sooftware

This repository contain various types of attention mechanism like Bahdanau , Soft attention , Additive Attention , Hierarchical Attention etc in Pytorch, Tensorflow, Keras

monk1337

Visualization for simple attention and Google's multi-head attention.

zhaocq-nlp

"Attention, Learn to Solve Routing Problems!"[Kool+, 2019], Capacitated Vehicle Routing Problem solver

Rintarooo

A Faster Pytorch Implementation of Multi-Head Self-Attention

datnnt1997

EMNLP 2018: Multi-Head Attention with Disagreement Regularization; NAACL 2019: Information Aggregation for Multi-Head Attention with Routing-by-Agreement

jack57lee

This is the official repository of the original Point Transformer architecture.

engelnico