What is the proper way to install GeoDream?

[hayoung-jeremy]

information

• tested on LambdaCloud's A10 24GB PCle GPU instance
• ubuntu 22.04

Tue Apr 16 09:31:55 2024       
+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.129.03             Driver Version: 535.129.03   CUDA Version: 12.2     |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  NVIDIA A10                     On  | 00000000:08:00.0 Off |                    0 |
|  0%   28C    P8               9W / 150W |      4MiB / 23028MiB |      0%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+
                                                                                         
+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|  No running processes found                                                           |
+---------------------------------------------------------------------------------------+

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Tue_Aug_15_22:02:13_PDT_2023
Cuda compilation tools, release 12.2, V12.2.140
Build cuda_12.2.r12.2/compiler.33191640_0

What is the proper way to install GeoDream?

The way I did

1. install threestudio via Dockerfile

2. install GeoDream's threestudio branch on threestudio's custom directory

   cd custom
   git clone -b threestudio https://github.com/baaivision/GeoDream.git
   mv GeoDream threestudio-geodream
   
   

3. now what should I do next?

   the mv-diffusion's README.md says :

   conda create --name geodream_mv python=3.8
   conda activate geodream_mv
   pip install torch torchvision --index-url https://download.pytorch.org/whl/cu118
   pip install inplace_abn
   sudo apt-get install libsparsehash-dev
   pip install git+https://github.com/mit-han-lab/[email protected]
   pip install -r requirements.txt
   

   but I'm on a docker container now. And the cuda version on my GPU instance(12.2) mismatches with the installation guide's version(11.8). I'm so confused how to properly install GeoDream. Please help, thanks in advance.

[hayoung-jeremy]

I've tried

cd /threestudio-geodream/mv-diffusion
conda create -n geodream_mv python=3.8
conda activate geodream_mv
pip install torch torchvision --index-url https://download.pytorch.org/whl/cu118
pip install inplace_abn

but got the following error :

Defaulting to user installation because normal site-packages is not writeable
Collecting inplace_abn
  Downloading inplace-abn-1.1.0.tar.gz (137 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 137.3/137.3 kB 4.2 MB/s eta 0:00:00
  Preparing metadata (setup.py) ... done
Building wheels for collected packages: inplace_abn
  Building wheel for inplace_abn (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [43 lines of output]
      /usr/lib/python3/dist-packages/pkg_resources/__init__.py:116: PkgResourcesDeprecationWarning: 1.12.1-git20200711.33e2d80-dfsg1-0.6 is an invalid version and will not be supported in a future release
        warnings.warn(
      /usr/lib/python3/dist-packages/setuptools/installer.py:27: SetuptoolsDeprecationWarning: setuptools.installer is deprecated. Requirements should be satisfied by a PEP 517 installer.
        warnings.warn(
      /tmp/pip-install-eb_gqsj2/inplace-abn_bcb46c38a6fe44afab9ce928d04e8639/.eggs/setuptools_scm-8.0.4-py3.10.egg/setuptools_scm/_integration/setuptools.py:30: RuntimeWarning:
      ERROR: setuptools==59.6.0 is used in combination with setuptools_scm>=8.x
      
      Your build configuration is incomplete and previously worked by accident!
      setuptools_scm requires setuptools>=61
      
      Suggested workaround if applicable:
       - migrating from the deprecated setup_requires mechanism to pep517/518
         and using a pyproject.toml to declare build dependencies
         which are reliably pre-installed before running the build tools
      
        warnings.warn(
      WARNING setuptools_scm.pyproject_reading toml section missing 'pyproject.toml does not contain a tool.setuptools_scm section'
      running bdist_wheel
      /usr/lib/python3/dist-packages/torch/utils/cpp_extension.py:484: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
        warnings.warn(msg.format('we could not find ninja.'))
      running build
      running build_py
      creating build
      creating build/lib.linux-x86_64-3.10
      creating build/lib.linux-x86_64-3.10/inplace_abn
      copying inplace_abn/_version.py -> build/lib.linux-x86_64-3.10/inplace_abn
      copying inplace_abn/abn.py -> build/lib.linux-x86_64-3.10/inplace_abn
      copying inplace_abn/group.py -> build/lib.linux-x86_64-3.10/inplace_abn
      copying inplace_abn/__init__.py -> build/lib.linux-x86_64-3.10/inplace_abn
      copying inplace_abn/functions.py -> build/lib.linux-x86_64-3.10/inplace_abn
      running build_ext
      building 'inplace_abn._backend' extension
      creating build/temp.linux-x86_64-3.10
      creating build/temp.linux-x86_64-3.10/src
      x86_64-linux-gnu-gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DWITH_CUDA=1 -I/tmp/pip-install-eb_gqsj2/inplace-abn_bcb46c38a6fe44afab9ce928d04e8639/include -I/usr/lib/python3/dist-packages/torch/include -I/usr/lib/python3/dist-packages/torch/include/torch/csrc/api/include -I/usr/lib/python3/dist-packages/torch/include/TH -I/usr/lib/python3/dist-packages/torch/include/THC -I/usr/include/python3.10 -c src/inplace_abn.cpp -o build/temp.linux-x86_64-3.10/src/inplace_abn.o -O3 -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1016" -DTORCH_EXTENSION_NAME=_backend -D_GLIBCXX_USE_CXX11_ABI=1 -std=c++17
      In file included from /usr/lib/python3/dist-packages/torch/include/torch/csrc/api/include/torch/python.h:11,
                       from /usr/lib/python3/dist-packages/torch/include/torch/extension.h:6,
                       from src/inplace_abn.cpp:3:
      /usr/lib/python3/dist-packages/torch/include/torch/csrc/Exceptions.h:14:10: fatal error: pybind11/pybind11.h: No such file or directory
         14 | #include <pybind11/pybind11.h>
            |          ^~~~~~~~~~~~~~~~~~~~~
      compilation terminated.
      error: command '/usr/bin/x86_64-linux-gnu-gcc' failed with exit code 1
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for inplace_abn
  Running setup.py clean for inplace_abn
Failed to build inplace_abn
ERROR: Could not build wheels for inplace_abn, which is required to install pyproject.toml-based projects

[notice] A new release of pip is available: 23.3.1 -> 24.0
[notice] To update, run: /usr/bin/python3 -m pip install --upgrade pip