flash-attention
flash-attention copied to clipboard
Dao-AILab
Getting Error While Extracting
Extracting flash_attn-3.0.0b1-py3.12-linux-x86_64.egg to /data/conda/envs/vllm/lib/python3.12/site-packages
Adding flash-attn 3.0.0b1 to easy-install.pth file
Installed /data/conda/envs/vllm/lib/python3.12/site-packages/flash_attn-3.0.0b1-py3.12-linux-x86_64.egg
Processing dependencies for flash-attn==3.0.0b1
Searching for ninja==1.11.1.3
Best match: ninja 1.11.1.3
Processing ninja-1.11.1.3-py3.12-linux-x86_64.egg
Adding ninja 1.11.1.3 to easy-install.pth file
Traceback (most recent call last):
File "/home/A06506/test/flash-attention/hopper/setup.py", line 600, in
setup(
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/init.py", line 117, in setup
return distutils.core.setup(**attrs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 183, in setup
return run_commands(dist)
^^^^^^^^^^^^^^^^^^
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/_distutils/core.py", line 199, in run_commands
dist.run_commands()
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 954, in run_commands
self.run_command(cmd)
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/dist.py", line 950, in run_command
super().run_command(command)
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/_distutils/dist.py", line 973, in run_command
cmd_obj.run()
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/install.py", line 97, in run
self.do_egg_install()
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/install.py", line 158, in do_egg_install
cmd.run(show_deprecation=False)
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 439, in run
self.easy_install(spec, not self.no_deps)
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 689, in easy_install
return self.install_item(None, spec, tmpdir, deps, True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 739, in install_item
self.process_distribution(spec, dist, deps)
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 799, in process_distribution
self.easy_install(dist.as_requirement())
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 712, in easy_install
return self.install_item(spec, dist.location, tmpdir, deps)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 742, in install_item
self.process_distribution(spec, dists[0], deps, "Using")
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 770, in process_distribution
self.install_egg_scripts(dist)
File "/data/conda/envs/vllm/lib/python3.12/site-packages/setuptools/command/easy_install.py", line 639, in install_egg_scripts
dist, script_name, dist.get_metadata('scripts/' + script_name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/data/conda/envs/vllm/lib/python3.12/site-packages/pkg_resources/init.py", line 1703, in get_metadata
return value.decode('utf-8')
^^^^^^^^^^^^^^^^^^^^^
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xac in position 25: invalid start byte in scripts/ninja file at path: /data/conda/envs/vllm/lib/python3.12/site-packages/ninja-1.11.1.3-py3.12-linux-x86_64.egg/EGG-INFO/scripts/ninja
I am able to reproduce this by installing FA3 on a GH200 in a clean virtualenv.
$ python3 --version
Python 3.10.12
Not specfically for this repo, but for the exactly same error. Downgrading ninja version from 1.11.1.4 to 1.11.1.3 does work for me. (cuda11.1 python3.9.13)
