flash-attention topic

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

Bruce-Lee-LY

Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.

Bruce-Lee-LY

Triton implementation of FlashAttention2 that adds Custom Masks.

alexzhang13

[CVPR 2025 Highlight] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training schem...

DAMO-NLP-SG