FoundationPose
FoundationPose copied to clipboard
NVlabs
Failure during build_all.sh
Hi,
I am trying to get foundationpose to work on my machine. Specs: Ubuntu 24.04 Graphics Card: L40S CUDA: 12.9 Driver 575.51.03 Unfortunately I cannot get it to run. I use the recommended docker setup, but it fails in both cases when using the image: wenbowen123/foundationpose and shingarey/foundationpose_custom_cuda121:latest in the build step, when running bash build_all.sh in the container, I get the following error:
`Obtaining file:///home/ubuntu/FoundationPose/bundlesdf/mycuda Preparing metadata (setup.py) ... done Installing collected packages: common Running setup.py develop for common error: subprocess-exited-with-error
× python setup.py develop did not run successfully.
│ exit code: 1
╰─> [139 lines of output]
running develop
running egg_info
creating common.egg-info
writing common.egg-info/PKG-INFO
writing dependency_links to common.egg-info/dependency_links.txt
writing top-level names to common.egg-info/top_level.txt
writing manifest file 'common.egg-info/SOURCES.txt'
reading manifest file 'common.egg-info/SOURCES.txt'
writing manifest file 'common.egg-info/SOURCES.txt'
running build_ext
building 'common' extension
creating /home/ubuntu/FoundationPose/bundlesdf/mycuda/build
creating /home/ubuntu/FoundationPose/bundlesdf/mycuda/build/temp.linux-x86_64-cpython-38
/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/dist.py:265: UserWarning: Unknown distribution option: 'extra_cflags'
warnings.warn(msg)
/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/dist.py:265: UserWarning: Unknown distribution option: 'extra_cuda_cflags'
warnings.warn(msg)
/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/command/develop.py:40: EasyInstallDeprecationWarning: easy_install command is deprecated.
!!
********************************************************************************
Please avoid running ``setup.py`` and ``easy_install``.
Instead, use pypa/build, pypa/installer or other
standards-based tools.
See https://github.com/pypa/setuptools/issues/917 for details.
********************************************************************************
!!
easy_install.initialize_options(self)
/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
!!
********************************************************************************
Please avoid running ``setup.py`` directly.
Instead, use pypa/build, pypa/installer or other
standards-based tools.
See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
********************************************************************************
!!
self.initialize_options()
/opt/conda/envs/my/lib/python3.8/site-packages/torch/utils/cpp_extension.py:424: UserWarning: There are no g++ version bounds defined for CUDA version 12.1
warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
Emitting ninja build file /home/ubuntu/FoundationPose/bundlesdf/mycuda/build/temp.linux-x86_64-cpython-38/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/2] /usr/local/cuda/bin/nvcc -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/TH -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/usr/local/include/eigen3 -I/usr/include/eigen3 -I/opt/conda/envs/my/include/python3.8 -I/opt/conda/envs/my/include/python3.8 -c -c /home/ubuntu/FoundationPose/bundlesdf/mycuda/common.cu -o /home/ubuntu/FoundationPose/bundlesdf/mycuda/build/temp.linux-x86_64-cpython-38/common.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -Xcompiler -O3 -std=c++14 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=common -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_89,code=compute_89 -gencode=arch=compute_89,code=sm_89
FAILED: /home/ubuntu/FoundationPose/bundlesdf/mycuda/build/temp.linux-x86_64-cpython-38/common.o
/usr/local/cuda/bin/nvcc -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/TH -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/usr/local/include/eigen3 -I/usr/include/eigen3 -I/opt/conda/envs/my/include/python3.8 -I/opt/conda/envs/my/include/python3.8 -c -c /home/ubuntu/FoundationPose/bundlesdf/mycuda/common.cu -o /home/ubuntu/FoundationPose/bundlesdf/mycuda/build/temp.linux-x86_64-cpython-38/common.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -Xcompiler -O3 -std=c++14 -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=common -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_89,code=compute_89 -gencode=arch=compute_89,code=sm_89
In file included from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/c10/util/string_view.h:4,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/c10/util/StringUtil.h:6,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:5,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/ATen/core/Generator.h:11,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/ATen/CPUGeneratorImpl.h:3,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/ATen/Context.h:3,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/ATen/cuda/CUDAContext.h:18,
from /home/ubuntu/FoundationPose/bundlesdf/mycuda/common.cu:17:
/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/c10/util/C++17.h:27:2: error: #error You need C++17 to compile PyTorch
27 | #error You need C++17 to compile PyTorch
| ^~~~~
In file included from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/torch.h:3,
from /home/ubuntu/FoundationPose/bundlesdf/mycuda/common.cu:18:
/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4:2: error: #error C++17 or later compatible compiler is required to use PyTorch.
4 | #error C++17 or later compatible compiler is required to use PyTorch.
| ^~~~~
In file included from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:4,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:9,
from /opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/torch.h:3,
from /home/ubuntu/FoundationPose/bundlesdf/mycuda/common.cu:18:
/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/ATen/ATen.h:4:2: error: #error C++17 or later compatible compiler is required to use ATen.
4 | #error C++17 or later compatible compiler is required to use ATen.
| ^~~~~
[2/2] c++ -MMD -MF /home/ubuntu/FoundationPose/bundlesdf/mycuda/build/temp.linux-x86_64-cpython-38/bindings.o.d -pthread -B /opt/conda/envs/my/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/TH -I/opt/conda/envs/my/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda/include -I/usr/local/include/eigen3 -I/usr/include/eigen3 -I/opt/conda/envs/my/include/python3.8 -I/opt/conda/envs/my/include/python3.8 -c -c /home/ubuntu/FoundationPose/bundlesdf/mycuda/bindings.cpp -o /home/ubuntu/FoundationPose/bundlesdf/mycuda/build/temp.linux-x86_64-cpython-38/bindings.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=common -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++17
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/opt/conda/envs/my/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 2100, in _run_ninja_build
subprocess.run(
File "/opt/conda/envs/my/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "<string>", line 2, in <module>
File "<pip-setuptools-caller>", line 34, in <module>
File "/home/ubuntu/FoundationPose/bundlesdf/mycuda/setup.py", line 21, in <module>
setup(
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/__init__.py", line 103, in setup
return distutils.core.setup(**attrs)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 185, in setup
return run_commands(dist)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
dist.run_commands()
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
self.run_command(cmd)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/dist.py", line 989, in run_command
super().run_command(command)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/command/develop.py", line 34, in run
self.install_for_development()
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/command/develop.py", line 109, in install_for_development
self.run_command('build_ext')
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
self.distribution.run_command(command)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/dist.py", line 989, in run_command
super().run_command(command)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
cmd_obj.run()
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 88, in run
_build_ext.run(self)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
self.build_extensions()
File "/opt/conda/envs/my/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 873, in build_extensions
build_ext.build_extensions(self)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
self._build_extensions_serial()
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
self.build_extension(ext)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 249, in build_extension
_build_ext.build_extension(self, ext)
File "/opt/conda/envs/my/lib/python3.8/site-packages/setuptools/_distutils/command/build_ext.py", line 548, in build_extension
objects = self.compiler.compile(
File "/opt/conda/envs/my/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 686, in unix_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "/opt/conda/envs/my/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 1774, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/opt/conda/envs/my/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 2116, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error `
Hi sebos123,I also encountered this situation, how did you solve it in the end?
This is my solution, does it works for you? https://github.com/NVlabs/FoundationPose/issues/384#issue-3528819596
