triton icon indicating copy to clipboard operation
triton copied to clipboard

pip install -e python failed

Open SeekPoint opened this issue 1 year ago • 13 comments

(triton) amd00@MZ32-00:~/yk_repo/triton$ pip install -e python Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Obtaining file:///home/amd00/yk_repo/triton/python Installing build dependencies ... done Checking if build backend supports build_editable ... done Getting requirements to build editable ... error error: subprocess-exited-with-error

× Getting requirements to build editable did not run successfully. │ exit code: 1 ╰─> [23 lines of output] copy /home/amd00/.triton/nvidia/bin/ptxas to /home/amd00/yk_repo/triton/python/../third_party/nvidia/backend/bin/ptxas ... copy /home/amd00/.triton/nvidia/bin/cuobjdump to /home/amd00/yk_repo/triton/python/../third_party/nvidia/backend/bin/cuobjdump ... copy /home/amd00/.triton/nvidia/bin/nvdisasm to /home/amd00/yk_repo/triton/python/../third_party/nvidia/backend/bin/nvdisasm ... Traceback (most recent call last): File "/home/amd00/yk_repo/triton/.venv/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in main() File "/home/amd00/yk_repo/triton/.venv/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main json_out['return_val'] = hook(**hook_input['kwargs']) File "/home/amd00/yk_repo/triton/.venv/lib/python3.10/site-packages/pip/_vendor/pep517/in_process/_in_process.py", line 144, in get_requires_for_build_editable return hook(config_settings) File "/tmp/pip-build-env-ynp8zldk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 441, in get_requires_for_build_editable return self.get_requires_for_build_wheel(config_settings) File "/tmp/pip-build-env-ynp8zldk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 325, in get_requires_for_build_wheel return self._get_build_requires(config_settings, requirements=['wheel']) File "/tmp/pip-build-env-ynp8zldk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 295, in _get_build_requires self.run_setup() File "/tmp/pip-build-env-ynp8zldk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 480, in run_setup super(_BuildMetaLegacyBackend, self).run_setup(setup_script=setup_script) File "/tmp/pip-build-env-ynp8zldk/overlay/lib/python3.10/site-packages/setuptools/build_meta.py", line 311, in run_setup exec(code, locals()) File "", line 383, in File "", line 52, in _copy_backends AssertionError [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error

× Getting requirements to build editable did not run successfully. │ exit code: 1 ╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip. (triton) amd00@MZ32-00:~/yk_repo/triton$

SeekPoint avatar Jan 25 '24 08:01 SeekPoint

This

(triton) amd00@MZ32-00:~/yk_repo/triton$ pip install -e python

looks to my inexperienced eyes, to be attempting to build the programming language python and not the directory under triton.

Something to try is giving the full path to the subdirectory you are trying to build.

evelynmitchell avatar Jan 28 '24 15:01 evelynmitchell

You should use pip install -e . in the dir where has the setup.py or pyproject.toml

LukeLIN-web avatar Feb 02 '24 15:02 LukeLIN-web

amd00@MZ32-00:~/yk_repo/triton/python$ export LLVM_BUILD_DIR=$HOME/yk_repo/llvm-project/build amd00@MZ32-00:~/yk_repo/triton/python$ LLVM_INCLUDE_DIRS=$LLVM_BUILD_DIR/include LLVM_LIBRARY_DIR=$LLVM_BUILD_DIR/lib LLVM_SYSPATH=$LLVM_BUILD_DIR pip install -e . Defaulting to user installation because normal site-packages is not writeable Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple Obtaining file:///home/amd00/yk_repo/triton/python Installing build dependencies ... done Checking if build backend supports build_editable ... done Getting requirements to build wheel ... error error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [28 lines of output] Traceback (most recent call last): File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in main() File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main json_out['return_val'] = hook(**hook_input['kwargs']) File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 130, in get_requires_for_build_wheel return hook(config_settings) File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 162, in get_requires_for_build_wheel return self._get_build_requires( File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 143, in _get_build_requires self.run_setup() File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 267, in run_setup super(_BuildMetaLegacyBackend, File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 158, in run_setup exec(compile(code, file, 'exec'), locals()) File "setup.py", line 372, in download_and_copy( File "setup.py", line 220, in download_and_copy curr_version = subprocess.check_output([dst_path, "--version"]).decode("utf-8").strip() File "/usr/lib/python3.10/subprocess.py", line 421, in check_output return run(*popenargs, stdout=PIPE, timeout=timeout, check=True, File "/usr/lib/python3.10/subprocess.py", line 503, in run with Popen(*popenargs, **kwargs) as process: File "/usr/lib/python3.10/subprocess.py", line 971, in init self._execute_child(args, executable, preexec_fn, close_fds, File "/usr/lib/python3.10/subprocess.py", line 1863, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) PermissionError: [Errno 13] Permission denied: '../third_party/nvidia/backend/bin/ptxas' [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip. amd00@MZ32-00:~/yk_repo/triton/python$ ll total 56 drwxrwxr-x 8 amd00 amd00 4096 2月 13 19:46 ./ drwxrwxr-x 15 amd00 amd00 4096 2月 13 19:46 ../ drwxrwxr-x 2 amd00 amd00 4096 1月 25 20:46 examples/ -rw-rw-r-- 1 amd00 amd00 0 1月 25 20:46 MANIFEST.in -rw-rw-r-- 1 amd00 amd00 326 1月 25 20:46 pyproject.toml -rw-rw-r-- 1 amd00 amd00 18048 2月 13 19:46 setup.py drwxrwxr-x 2 amd00 amd00 4096 2月 13 19:46 src/ drwxrwxr-x 7 amd00 amd00 4096 1月 25 20:45 test/ drwxrwxr-x 9 amd00 amd00 4096 1月 25 20:46 triton/ drwxrwxr-x 2 amd00 amd00 4096 1月 25 21:41 triton.egg-info/ drwxrwxr-x 2 amd00 amd00 4096 1月 25 20:46 tutorials/ amd00@MZ32-00:~/yk_repo/triton/python$ amd00@MZ32-00:~/yk_repo/triton/python$

SeekPoint avatar Feb 13 '24 12:02 SeekPoint

root@MZ32-00:/home/amd00/yk_repo/triton/python# LLVM_INCLUDE_DIRS=$LLVM_BUILD_DIR/include LLVM_LIBRARY_DIR=$LLVM_BUILD_DIR/lib LLVM_SYSPATH=$LLVM_BUILD_DIR sudo pip install -e . Obtaining file:///home/amd00/yk_repo/triton/python Installing build dependencies ... done Checking if build backend supports build_editable ... done Getting requirements to build wheel ... error error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [27 lines of output] copy /root/.triton/nvidia/bin/ptxas to ../third_party/nvidia/backend/bin/ptxas ... copy /root/.triton/nvidia/bin/cuobjdump to ../third_party/nvidia/backend/bin/cuobjdump ... copy /root/.triton/nvidia/bin/nvdisasm to ../third_party/nvidia/backend/bin/nvdisasm ... Traceback (most recent call last): File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 363, in main() File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 345, in main json_out['return_val'] = hook(**hook_input['kwargs']) File "/usr/lib/python3/dist-packages/pip/_vendor/pep517/in_process/_in_process.py", line 130, in get_requires_for_build_wheel return hook(config_settings) File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 162, in get_requires_for_build_wheel return self._get_build_requires( File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 143, in _get_build_requires self.run_setup() File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 267, in run_setup super(_BuildMetaLegacyBackend, File "/usr/lib/python3/dist-packages/setuptools/build_meta.py", line 158, in run_setup exec(compile(code, file, 'exec'), locals()) File "setup.py", line 394, in backends = [*BackendInstaller.copy(["nvidia", "amd"]), *BackendInstaller.copy_externals()] File "setup.py", line 69, in copy return [BackendInstaller.prepare(backend) for backend in active] File "setup.py", line 69, in return [BackendInstaller.prepare(backend) for backend in active] File "setup.py", line 59, in prepare assert os.path.exists(os.path.join(backend_path, file)), f"${file} does not exist in ${backend_path}" AssertionError: $compiler.py does not exist in $/home/amd00/yk_repo/triton/third_party/nvidia/backend [end of output]

note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip. root@MZ32-00:/home/amd00/yk_repo/triton/python#

SeekPoint avatar Feb 13 '24 12:02 SeekPoint

I encountered similar issue, did you figure it out? Thanks.

j2u123 avatar Feb 25 '24 13:02 j2u123

Same question here.

Juelianqvq avatar Feb 25 '24 15:02 Juelianqvq

  1. Remove your your triton directory and clone it from github again.
  2. Setup MAX_JOBS=<n>, where <n> is a small number, depending on your processor.

Jokeren avatar Feb 26 '24 00:02 Jokeren

  1. Remove your your triton directory and clone it from github again.
  2. Setup MAX_JOBS=<n>, where <n> is a small number, depending on your processor.

still struggling with following error: Permission denied: '.../triton/python/../third_party/nvidia/backend/bin/nvdisasm'

Juelianqvq avatar Feb 26 '24 12:02 Juelianqvq

still struggling with following error: Permission denied: '.../triton/python/../third_party/nvidia/backend/bin/nvdisasm'

Most likely because you used "sudo" which copied nvdisasm as root and now you are trying to delete the file under your user account.

You can do "sudo rm -rf .../triton/python/../third_party/nvidia/backend/bin/nvdisasm" to remove the file

aaronsm avatar Mar 01 '24 00:03 aaronsm

Have anyone figured out the solution? @aaronsm i was running in the container. and there is no sudo permissions. still i get the same error. @jokeren even after removing and cloning the repo. i still get the same error.

cosmic-heart avatar Mar 24 '24 12:03 cosmic-heart

any update on the error? Experienced this issue on a newly setup EC2 instance.

wangrui6 avatar May 07 '24 19:05 wangrui6