luminal icon indicating copy to clipboard operation
luminal copied to clipboard

Published 20 hours ago • verified publisher icon jafioti

FlashAttention

Open jafioti opened this issue 1 year ago • 1 comments

jafioti avatar Jan 20 '24 22:01 jafioti

End goal is to automatically discover flash attention, but lots of work still needs to be done on an IR. For now lets hand code a kernel and find-and-replace it

jafioti avatar Jan 21 '24 16:01 jafioti