ffpa-attn icon indicating copy to clipboard operation
ffpa-attn copied to clipboard

Published 1 month ago • verified publisher icon xlite-dev
→

Metadata

🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.

← Metadata

242
Stars
12
Forks
242
Watchers

Owner

verified publisher icon xlite-dev

Metadata

🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.

Back