ModuleNotFoundError: No module named 'flash_attn_2_cuda'

[Hansyvea]

Python 3.10.13 (main, Sep 11 2023, 13:44:35) [GCC 11.2.0] on linux Type "help", "copyright", "credits" or "license" for more information.

import flash_attn Traceback (most recent call last): File "", line 1, in File "/home/xxx/githubRepo/flash-attention/flash_attn/init.py", line 3, in from flash_attn.flash_attn_interface import ( File "/home/xxx/githubRepo/flash-attention/flash_attn/flash_attn_interface.py", line 10, in import flash_attn_2_cuda as flash_attn_cuda ModuleNotFoundError: No module named 'flash_attn_2_cuda'

env: cuda_version:12.2 torch:2.1

Why would this happen?

[yqin-falling-stars]

hi bro! did you solve it?

[coderchem]

me too，did you solve it?

[rantianhua]

same error.

[saurabh-kataria]

still getting this error