Liger-Kernel icon indicating copy to clipboard operation
Liger-Kernel copied to clipboard

Published 20 hours ago • verified publisher icon linkedin

Grouped Latent Attention

Open AndreSlavescu opened this issue 6 months ago • 0 comments

🚀 The feature, motivation and pitch

New work from Prof. Dao's lab that improves on Deepseek's original Multihead Latent Attention.

Relevant Paper: https://arxiv.org/pdf/2505.21487

Alternatives

No response

Additional context

No response

AndreSlavescu avatar May 28 '25 18:05 AndreSlavescu