apex
apex copied to clipboard
ModuleNotFoundError: No module named 'fast_multihead_attn'
Describe the Bug after I install apex, "import apex.contrib.multihead_attn"produce this bug Minimal Steps/Code to Reproduce the Bug
- just install apex by using this command:
pip install -v --disable-pip-version-check --no-cache-dir --no-build-isolation --global-option="--cpp_ext" --global-option="--cuda_ext" ./
- "import apex.contrib.multihead_attn"
Expected Behavior
no bug occur
Environment
os:ubuntu python:3.10.6 cuda:11.6 pytorch:1.12.1