Mohamed El Bahnasawi

icon company Universität Klagenfurt icon location Austria icon location - 👋 Hi, I’m @mohamedelbahnasawi - 🌱 ML Engineer & PhD Researcher - 👀 I’m interested in Generative AI

Results 1 issues of Mohamed El Bahnasawi

Q: Attention Calculation

5 comment

Hi @fkodom, I really like your implementation and I wanted to use dilated attention into a vanilla transformer model to try how things work. Right now, I am facing a...