flash-attention icon indicating copy to clipboard operation
flash-attention copied to clipboard

Published 20 hours ago • verified publisher icon Dao-AILab

Has anyone successfully compiled this on ARM Linux (aarch64)?

Open elkay opened this issue 11 months ago • 3 comments

I want to use this on a newer AWS Graviton server but anything I've done to try to get it to compile from sources has completely hung the process until I abort. No error output. I'm used to longer compile times and don't believe this is the issue. CPU usage hovers around 1% so it's not doing anything. Not even sure how to go about debugging it.

elkay avatar Mar 07 '24 23:03 elkay

Actually, just noticed this PR.

https://github.com/Dao-AILab/flash-attention/pull/757

Seems like exactly what I'm looking for. Hopefully the PR can be approved.

elkay avatar Mar 07 '24 23:03 elkay

Does either #757 or #724 work for you?

tridao avatar Mar 07 '24 23:03 tridao

Does either #757 or #724 work for you?

757 did end up working for me.

elkay avatar Mar 08 '24 04:03 elkay