MIVisionX icon indicating copy to clipboard operation
MIVisionX copied to clipboard

ONNX V1.11.0 Failure - Inference with vx_nn

Open kiritigowda opened this issue 2 years ago • 8 comments

ONNX version 1.11.0 fails to install on Ubuntu 22.04, upgrading to latest 1.14.1 does not work well with caffe. Need to find a version that we can upgrade to.

sudo pip3 install protobuf==3.12.4 onnx==1.11.0
Collecting protobuf==3.12.4
  Using cached protobuf-3.12.4-py2.py3-none-any.whl (443 kB)
Collecting onnx==1.11.0
  Using cached onnx-1.11.0.tar.gz (9.9 MB)
  Preparing metadata (setup.py) ... done
Requirement already satisfied: six>=1.9 in /usr/local/lib/python3.10/dist-packages (from protobuf==3.12.4) (1.16.0)
Requirement already satisfied: setuptools in /usr/lib/python3/dist-packages (from protobuf==3.12.4) (59.6.0)
Requirement already satisfied: numpy>=1.16.6 in /usr/local/lib/python3.10/dist-packages (from onnx==1.11.0) (1.21.0)
Requirement already satisfied: typing-extensions>=3.6.2.1 in /usr/local/lib/python3.10/dist-packages (from onnx==1.11.0) (4.8.0)
Building wheels for collected packages: onnx
  Building wheel for onnx (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py bdist_wheel did not run successfully.
  │ exit code: 1
  ╰─> [212 lines of output]
      fatal: not a git repository (or any of the parent directories): .git
      /usr/lib/python3/dist-packages/setuptools/installer.py:27: SetuptoolsDeprecationWarning: setuptools.installer is deprecated. Requirements should be satisfied by a PEP 517 installer.
        warnings.warn(
      running bdist_wheel
      running build
      running build_py
      running create_version
      running cmake_build
      Using cmake args: ['/usr/bin/cmake', '-DPYTHON_INCLUDE_DIR=/usr/include/python3.10', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-DBUILD_ONNX_PYTHON=ON', '-DCMAKE_EXPORT_COMPILE_COMMANDS=ON', '-DONNX_NAMESPACE=onnx', '-DPY_EXT_SUFFIX=.cpython-310-x86_64-linux-gnu.so', '-DCMAKE_BUILD_TYPE=Release', '-DONNX_ML=1', '/tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9']
      -- The C compiler identification is GNU 11.4.0
      -- The CXX compiler identification is GNU 11.4.0
      -- Detecting C compiler ABI info
      -- Detecting C compiler ABI info - done
      -- Check for working C compiler: /usr/bin/cc - skipped
      -- Detecting C compile features
      -- Detecting C compile features - done
      -- Detecting CXX compiler ABI info
      -- Detecting CXX compiler ABI info - done
      -- Check for working CXX compiler: /usr/bin/c++ - skipped
      -- Detecting CXX compile features
      -- Detecting CXX compile features - done
      -- Found PythonInterp: /usr/bin/python3 (found version "3.10.12")
      -- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.10.so (found version "3.10.12")
      -- Found Protobuf: /usr/lib/x86_64-linux-gnu/libprotobuf.a (found version "3.12.4")
      Generated: /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-ml.proto
      Generated: /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-operators-ml.proto
      Generated: /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-data.proto
      -- Found PythonLibs: /usr/lib/x86_64-linux-gnu/libpython3.10.so
      -- Performing Test HAS_FLTO
      -- Performing Test HAS_FLTO - Success
      -- Found pybind11: /usr/include (found version "2.9.1")
      --
      -- ******** Summary ********
      --   CMake version             : 3.22.1
      --   CMake command             : /usr/bin/cmake
      --   System                    : Linux
      --   C++ compiler              : /usr/bin/c++
      --   C++ compiler version      : 11.4.0
      --   CXX flags                 :  -Wnon-virtual-dtor
      --   Build type                : Release
      --   Compile definitions       : __STDC_FORMAT_MACROS
      --   CMAKE_PREFIX_PATH         :
      --   CMAKE_INSTALL_PREFIX      : /usr/local
      --   CMAKE_MODULE_PATH         :
      --
      --   ONNX version              : 1.11.0
      --   ONNX NAMESPACE            : onnx
      --   ONNX_USE_LITE_PROTO       : OFF
      --   USE_PROTOBUF_SHARED_LIBS  : OFF
      --   Protobuf_USE_STATIC_LIBS  : ON
      --   ONNX_DISABLE_EXCEPTIONS   : OFF
      --   ONNX_WERROR               : OFF
      --   ONNX_BUILD_TESTS          : OFF
      --   ONNX_BUILD_BENCHMARKS     : OFF
      --   ONNXIFI_DUMMY_BACKEND     : OFF
      --   ONNXIFI_ENABLE_EXT        : OFF
      --
      --   Protobuf compiler         : /usr/bin/protoc
      --   Protobuf includes         : /usr/include
      --   Protobuf libraries        : /usr/lib/x86_64-linux-gnu/libprotobuf.a
      --   BUILD_ONNX_PYTHON         : ON
      --     Python version        :
      --     Python executable     : /usr/bin/python3
      --     Python includes       : /usr/include/python3.10
      -- Configuring done
      -- Generating done
      -- Build files have been written to: /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build
      [  1%] Building C object CMakeFiles/onnxifi_dummy.dir/onnx/onnxifi_dummy.c.o
      [  2%] Running gen_proto.py on onnx/onnx.in.proto
      [  4%] Building C object CMakeFiles/onnxifi_loader.dir/onnx/onnxifi_loader.c.o
      Processing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/onnx.in.proto
      Writing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-ml.proto
      Writing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-ml.proto3
      generating /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx_pb.py
      [  5%] Linking C static library libonnxifi_loader.a
      [  7%] Running C++ protocol buffer compiler on /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-ml.proto
      [  8%] Linking C shared library libonnxifi_dummy.so
      [  8%] Built target onnxifi_dummy
      [  8%] Built target onnxifi_loader
      [  9%] Building C object CMakeFiles/onnxifi_wrapper.dir/onnx/onnxifi_wrapper.c.o
      Writing mypy to onnx/onnx_ml_pb2.pyi
      [  9%] Built target gen_onnx_proto
      [ 11%] Running gen_proto.py on onnx/onnx-operators.in.proto
      [ 12%] Running gen_proto.py on onnx/onnx-data.in.proto
      Processing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/onnx-operators.in.proto
      Writing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-operators-ml.proto
      Writing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-operators-ml.proto3
      generating /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx_operators_pb.py
      Processing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/onnx-data.in.proto
      Writing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-data.proto
      Writing /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-data.proto3
      generating /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx_data_pb.py
      [ 14%] Running C++ protocol buffer compiler on /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-operators-ml.proto
      [ 15%] Running C++ protocol buffer compiler on /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-data.proto
      [ 16%] Linking C shared module libonnxifi.so
      Writing mypy to onnx/onnx_operators_ml_pb2.pyi
      Writing mypy to onnx/onnx_data_pb2.pyi
      [ 16%] Built target onnxifi_wrapper
      [ 16%] Built target gen_onnx_operators_proto
      [ 16%] Built target gen_onnx_data_proto
      [ 18%] Building CXX object CMakeFiles/onnx_proto.dir/onnx/onnx-ml.pb.cc.o
      [ 19%] Building CXX object CMakeFiles/onnx_proto.dir/onnx/onnx-operators-ml.pb.cc.o
      [ 21%] Building CXX object CMakeFiles/onnx_proto.dir/onnx/onnx-data.pb.cc.o
      [ 22%] Linking CXX static library libonnx_proto.a
      [ 30%] Built target onnx_proto
      [ 32%] Building CXX object CMakeFiles/onnx.dir/onnx/common/path.cc.o
      [ 33%] Building CXX object CMakeFiles/onnx.dir/onnx/common/interned_strings.cc.o
      [ 35%] Building CXX object CMakeFiles/onnx.dir/onnx/common/assertions.cc.o
      [ 38%] Building CXX object CMakeFiles/onnx.dir/onnx/common/ir_pb_converter.cc.o
      [ 38%] Building CXX object CMakeFiles/onnx.dir/onnx/common/model_helpers.cc.o
      [ 39%] Building CXX object CMakeFiles/onnx.dir/onnx/checker.cc.o
      [ 40%] Building CXX object CMakeFiles/onnx.dir/onnx/common/status.cc.o
      [ 43%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/data_type_utils.cc.o
      [ 43%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/controlflow/old.cc.o
      [ 45%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/generator/defs.cc.o
      [ 46%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/controlflow/defs.cc.o
      [ 47%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/attr_proto_util.cc.o
      [ 49%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/function.cc.o
      [ 50%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/logical/defs.cc.o
      [ 52%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/generator/old.cc.o
      [ 53%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/logical/old.cc.o
      [ 54%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/math/defs.cc.o
      [ 56%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/math/old.cc.o
      [ 57%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/nn/defs.cc.o
      [ 59%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/nn/old.cc.o
      [ 61%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/object_detection/old.cc.o
      [ 61%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/object_detection/defs.cc.o
      [ 63%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/optional/defs.cc.o
      In file included from /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/common/ir_pb_converter.h:10,
                       from /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/common/ir_pb_converter.cc:8:
      In constructor ‘onnx::Dimension::Dimension(onnx::Dimension&&)’,
          inlined from ‘void __gnu_cxx::new_allocator<_Tp>::construct(_Up*, _Args&& ...) [with _Up = onnx::Dimension; _Args = {onnx::Dimension}; _Tp = onnx::Dimension]’ at /usr/include/c++/11/ext/new_allocator.h:162:4,
          inlined from ‘static void std::allocator_traits<std::allocator<_CharT> >::construct(std::allocator_traits<std::allocator<_CharT> >::allocator_type&, _Up*, _Args&& ...) [with _Up = onnx::Dimension; _Args = {onnx::Dimension}; _Tp = onnx::Dimension]’ at /usr/include/c++/11/bits/alloc_traits.h:516:17,
          inlined from ‘void std::vector<_Tp, _Alloc>::emplace_back(_Args&& ...) [with _Args = {onnx::Dimension}; _Tp = onnx::Dimension; _Alloc = std::allocator<onnx::Dimension>]’ at /usr/include/c++/11/bits/vector.tcc:115:30,
          inlined from ‘void std::vector<_Tp, _Alloc>::push_back(std::vector<_Tp, _Alloc>::value_type&&) [with _Tp = onnx::Dimension; _Alloc = std::allocator<onnx::Dimension>]’ at /usr/include/c++/11/bits/stl_vector.h:1204:21,
          inlined from ‘std::vector<onnx::Dimension> onnx::tensorShapeProtoToDimensions(const onnx::TensorShapeProto&)’ at /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/common/ir_pb_converter.cc:201:21:
      /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/common/ir.h:74:8: warning: ‘<unnamed>.onnx::Dimension::dim’ may be used uninitialized [-Wmaybe-uninitialized]
         74 | struct Dimension final {
            |        ^~~~~~~~~
      /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/common/ir_pb_converter.cc: In function ‘std::vector<onnx::Dimension> onnx::tensorShapeProtoToDimensions(const onnx::TensorShapeProto&)’:
      /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/onnx/common/ir_pb_converter.cc:201:32: note: ‘<anonymous>’ declared here
        201 |       dims.push_back(Dimension());
            |                                ^
      [ 67%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/printer.cc.o
      [ 67%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/quantization/old.cc.o
      [ 67%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/parser.cc.o
      [ 69%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/quantization/defs.cc.o
      [ 70%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/reduction/defs.cc.o
      [ 71%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/reduction/old.cc.o
      [ 73%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/rnn/defs.cc.o
      [ 74%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/rnn/old.cc.o
      [ 76%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/schema.cc.o
      [ 77%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/sequence/defs.cc.o
      [ 78%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/shape_inference.cc.o
      [ 80%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/tensor/defs.cc.o
      [ 81%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/tensor/old.cc.o
      [ 83%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/tensor/utils.cc.o
      [ 84%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/tensor_proto_util.cc.o
      [ 85%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/tensor_util.cc.o
      [ 87%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/traditionalml/defs.cc.o
      [ 88%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/traditionalml/old.cc.o
      [ 90%] Building CXX object CMakeFiles/onnx.dir/onnx/defs/training/defs.cc.o
      [ 91%] Building CXX object CMakeFiles/onnx.dir/onnx/onnxifi_utils.cc.o
      [ 92%] Building CXX object CMakeFiles/onnx.dir/onnx/shape_inference/implementation.cc.o
      [ 94%] Building CXX object CMakeFiles/onnx.dir/onnx/version_converter/convert.cc.o
      [ 95%] Building CXX object CMakeFiles/onnx.dir/onnx/version_converter/helper.cc.o
      [ 97%] Linking CXX static library libonnx.a
      [ 97%] Built target onnx
      [ 98%] Building CXX object CMakeFiles/onnx_cpp2py_export.dir/onnx/cpp2py_export.cc.o
      [100%] Linking CXX shared module onnx_cpp2py_export.cpython-310-x86_64-linux-gnu.so
      /usr/bin/ld: /usr/lib/x86_64-linux-gnu/libprotobuf.a(arena.o): relocation R_X86_64_TPOFF32 against hidden symbol `_ZN6google8protobuf8internal9ArenaImpl13thread_cache_E' can not be used when making a shared object
      /usr/bin/ld: failed to set dynamic section sizes: bad value
      collect2: error: ld returned 1 exit status
      gmake[2]: *** [CMakeFiles/onnx_cpp2py_export.dir/build.make:101: onnx_cpp2py_export.cpython-310-x86_64-linux-gnu.so] Error 1
      gmake[1]: *** [CMakeFiles/Makefile2:229: CMakeFiles/onnx_cpp2py_export.dir/all] Error 2
      gmake: *** [Makefile:136: all] Error 2
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/setup.py", line 336, in <module>
          setuptools.setup(
        File "/usr/lib/python3/dist-packages/setuptools/__init__.py", line 153, in setup
          return distutils.core.setup(**attrs)
        File "/usr/lib/python3.10/distutils/core.py", line 148, in setup
          dist.run_commands()
        File "/usr/lib/python3.10/distutils/dist.py", line 966, in run_commands
          self.run_command(cmd)
        File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
          cmd_obj.run()
        File "/usr/lib/python3/dist-packages/wheel/bdist_wheel.py", line 299, in run
          self.run_command('build')
        File "/usr/lib/python3.10/distutils/cmd.py", line 313, in run_command
          self.distribution.run_command(command)
        File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
          cmd_obj.run()
        File "/usr/lib/python3.10/distutils/command/build.py", line 135, in run
          self.run_command(cmd_name)
        File "/usr/lib/python3.10/distutils/cmd.py", line 313, in run_command
          self.distribution.run_command(command)
        File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
          cmd_obj.run()
        File "/tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/setup.py", line 232, in run
          self.run_command('cmake_build')
        File "/usr/lib/python3.10/distutils/cmd.py", line 313, in run_command
          self.distribution.run_command(command)
        File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
          cmd_obj.run()
        File "/tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/setup.py", line 226, in run
          subprocess.check_call(build_args)
        File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
          raise CalledProcessError(retcode, cmd)
      subprocess.CalledProcessError: Command '['/usr/bin/cmake', '--build', '.', '--', '-j', '16']' returned non-zero exit status 2.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for onnx
  Running setup.py clean for onnx
Failed to build onnx
Installing collected packages: protobuf, onnx
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.24.3
    Uninstalling protobuf-4.24.3:
      Successfully uninstalled protobuf-4.24.3
  Attempting uninstall: onnx
    Found existing installation: onnx 1.14.1
    Uninstalling onnx-1.14.1:
      Successfully uninstalled onnx-1.14.1
  Running setup.py install for onnx ... error
  error: subprocess-exited-with-error
  
  × Running setup.py install for onnx did not run successfully.
  │ exit code: 1
  ╰─> [110 lines of output]
      fatal: not a git repository (or any of the parent directories): .git
      /usr/lib/python3/dist-packages/setuptools/installer.py:27: SetuptoolsDeprecationWarning: setuptools.installer is deprecated. Requirements should be satisfied by a PEP 517 installer.
        warnings.warn(
      running install
      /usr/lib/python3/dist-packages/setuptools/command/install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
        warnings.warn(
      running build
      running build_py
      running create_version
      running cmake_build
      Using cmake args: ['/usr/bin/cmake', '-DPYTHON_INCLUDE_DIR=/usr/include/python3.10', '-DPYTHON_EXECUTABLE=/usr/bin/python3', '-DBUILD_ONNX_PYTHON=ON', '-DCMAKE_EXPORT_COMPILE_COMMANDS=ON', '-DONNX_NAMESPACE=onnx', '-DPY_EXT_SUFFIX=.cpython-310-x86_64-linux-gnu.so', '-DCMAKE_BUILD_TYPE=Release', '-DONNX_ML=1', '/tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9']
      Generated: /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-ml.proto
      Generated: /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-operators-ml.proto
      Generated: /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build/onnx/onnx-data.proto
      -- Found pybind11: /usr/include (found version "2.9.1")
      --
      -- ******** Summary ********
      --   CMake version             : 3.22.1
      --   CMake command             : /usr/bin/cmake
      --   System                    : Linux
      --   C++ compiler              : /usr/bin/c++
      --   C++ compiler version      : 11.4.0
      --   CXX flags                 :  -Wnon-virtual-dtor
      --   Build type                : Release
      --   Compile definitions       : __STDC_FORMAT_MACROS
      --   CMAKE_PREFIX_PATH         :
      --   CMAKE_INSTALL_PREFIX      : /usr/local
      --   CMAKE_MODULE_PATH         :
      --
      --   ONNX version              : 1.11.0
      --   ONNX NAMESPACE            : onnx
      --   ONNX_USE_LITE_PROTO       : OFF
      --   USE_PROTOBUF_SHARED_LIBS  : OFF
      --   Protobuf_USE_STATIC_LIBS  : ON
      --   ONNX_DISABLE_EXCEPTIONS   : OFF
      --   ONNX_WERROR               : OFF
      --   ONNX_BUILD_TESTS          : OFF
      --   ONNX_BUILD_BENCHMARKS     : OFF
      --   ONNXIFI_DUMMY_BACKEND     : OFF
      --   ONNXIFI_ENABLE_EXT        : OFF
      --
      --   Protobuf compiler         : /usr/bin/protoc
      --   Protobuf includes         : /usr/include
      --   Protobuf libraries        : /usr/lib/x86_64-linux-gnu/libprotobuf.a
      --   BUILD_ONNX_PYTHON         : ON
      --     Python version        :
      --     Python executable     : /usr/bin/python3
      --     Python includes       : /usr/include/python3.10
      -- Configuring done
      -- Generating done
      -- Build files have been written to: /tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/.setuptools-cmake-build
      Consolidate compiler generated dependencies of target onnxifi_dummy
      Consolidate compiler generated dependencies of target onnxifi_loader
      [  2%] Built target gen_onnx_proto
      [  5%] Built target onnxifi_dummy
      [  8%] Built target onnxifi_loader
      Consolidate compiler generated dependencies of target onnxifi_wrapper
      [ 11%] Built target gen_onnx_data_proto
      [ 14%] Built target gen_onnx_operators_proto
      [ 16%] Built target onnxifi_wrapper
      Consolidate compiler generated dependencies of target onnx_proto
      [ 30%] Built target onnx_proto
      Consolidate compiler generated dependencies of target onnx
      [ 97%] Built target onnx
      Consolidate compiler generated dependencies of target onnx_cpp2py_export
      [ 98%] Linking CXX shared module onnx_cpp2py_export.cpython-310-x86_64-linux-gnu.so
      /usr/bin/ld: /usr/lib/x86_64-linux-gnu/libprotobuf.a(arena.o): relocation R_X86_64_TPOFF32 against hidden symbol `_ZN6google8protobuf8internal9ArenaImpl13thread_cache_E' can not be used when making a shared object
      /usr/bin/ld: failed to set dynamic section sizes: bad value
      collect2: error: ld returned 1 exit status
      gmake[2]: *** [CMakeFiles/onnx_cpp2py_export.dir/build.make:101: onnx_cpp2py_export.cpython-310-x86_64-linux-gnu.so] Error 1
      gmake[1]: *** [CMakeFiles/Makefile2:229: CMakeFiles/onnx_cpp2py_export.dir/all] Error 2
      gmake: *** [Makefile:136: all] Error 2
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/setup.py", line 336, in <module>
          setuptools.setup(
        File "/usr/lib/python3/dist-packages/setuptools/__init__.py", line 153, in setup
          return distutils.core.setup(**attrs)
        File "/usr/lib/python3.10/distutils/core.py", line 148, in setup
          dist.run_commands()
        File "/usr/lib/python3.10/distutils/dist.py", line 966, in run_commands
          self.run_command(cmd)
        File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
          cmd_obj.run()
        File "/usr/lib/python3/dist-packages/setuptools/command/install.py", line 68, in run
          return orig.install.run(self)
        File "/usr/lib/python3.10/distutils/command/install.py", line 619, in run
          self.run_command('build')
        File "/usr/lib/python3.10/distutils/cmd.py", line 313, in run_command
          self.distribution.run_command(command)
        File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
          cmd_obj.run()
        File "/usr/lib/python3.10/distutils/command/build.py", line 135, in run
          self.run_command(cmd_name)
        File "/usr/lib/python3.10/distutils/cmd.py", line 313, in run_command
          self.distribution.run_command(command)
        File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
          cmd_obj.run()
        File "/tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/setup.py", line 232, in run
          self.run_command('cmake_build')
        File "/usr/lib/python3.10/distutils/cmd.py", line 313, in run_command
          self.distribution.run_command(command)
        File "/usr/lib/python3.10/distutils/dist.py", line 985, in run_command
          cmd_obj.run()
        File "/tmp/pip-install-uf25ymi0/onnx_2c0ec60173f24e0b824cd80d4310ace9/setup.py", line 226, in run
          subprocess.check_call(build_args)
        File "/usr/lib/python3.10/subprocess.py", line 369, in check_call
          raise CalledProcessError(retcode, cmd)
      subprocess.CalledProcessError: Command '['/usr/bin/cmake', '--build', '.', '--', '-j', '16']' returned non-zero exit status 2.
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  WARNING: No metadata found in /usr/local/lib/python3.10/dist-packages
  Rolling back uninstall of onnx
  Moving to /usr/local/bin/backend-test-tools
   from /tmp/pip-uninstall-fgi217q0/backend-test-tools
  Moving to /usr/local/bin/check-model
   from /tmp/pip-uninstall-fgi217q0/check-model
  Moving to /usr/local/bin/check-node
   from /tmp/pip-uninstall-fgi217q0/check-node
  Moving to /usr/local/lib/python3.10/dist-packages/onnx-1.14.1.dist-info/
   from /usr/local/lib/python3.10/dist-packages/~nnx-1.14.1.dist-info
  Moving to /usr/local/lib/python3.10/dist-packages/onnx/
   from /usr/local/lib/python3.10/dist-packages/~nnx
error: legacy-install-failure

× Encountered error while trying to install package.
╰─> onnx

note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.

kiritigowda avatar Oct 04 '23 05:10 kiritigowda

Upgrading to sudo pip3 install protobuf==3.20.2 onnx==1.13.0 seems to work better. @hansely needs to verify. @paveltc need to test.

kiritigowda avatar Oct 04 '23 05:10 kiritigowda

@kiritigowda Isn't caffe and onnx independent of each other? How does changing the onnx version affect caffe?

hansely avatar Oct 04 '23 22:10 hansely

@hansely ONNX deps for 1.11.0 is different from 1.13.0, these deps are common for caffe & ONNX.

kiritigowda avatar Oct 04 '23 22:10 kiritigowda

Hi @hansely any thoughts on this?

kiritigowda avatar Oct 06 '23 19:10 kiritigowda

Use future-0.18.3

kiritigowda avatar Oct 12 '23 18:10 kiritigowda

@hansely can we close this issue?

kiritigowda avatar Jan 18 '24 02:01 kiritigowda

@kiritigowda Will update the issue after verification tomorrow

hansely avatar Jan 18 '24 03:01 hansely

@kiritigowda Using protobuf==3.20.2 / onnx==1.13.0 version works well for both caffe & onnx models. We can close the issue after updating the setup script.

hansely avatar Jan 27 '24 01:01 hansely

Updated to ONNX 1.12.0 on TOT; maybe we can move to 1.13.0 -- Link issue to #1171

kiritigowda avatar Mar 20 '24 14:03 kiritigowda

  -- ******** Summary ********
  --   CMake version             : 3.20.4
  --   CMake command             : /usr/bin/cmake
  --   System                    : Linux
  --   C++ compiler              : /usr/bin/c++
  --   C++ compiler version      : 7.5.0
  --   CXX flags                 :  -Wnon-virtual-dtor
  --   Build type                : Release
  --   Compile definitions       : __STDC_FORMAT_MACROS
  --   CMAKE_PREFIX_PATH         :
  --   CMAKE_INSTALL_PREFIX      : /usr/local
  --   CMAKE_MODULE_PATH         :
  --
  --   ONNX version              : 1.12.0
  --   ONNX NAMESPACE            : onnx
  --   ONNX_USE_LITE_PROTO       : OFF
  --   USE_PROTOBUF_SHARED_LIBS  : OFF
  --   Protobuf_USE_STATIC_LIBS  : ON
  --   ONNX_DISABLE_EXCEPTIONS   : OFF
  --   ONNX_WERROR               : OFF
  --   ONNX_BUILD_TESTS          : OFF
  --   ONNX_BUILD_BENCHMARKS     : OFF
  --   ONNXIFI_DUMMY_BACKEND     : OFF
  --   ONNXIFI_ENABLE_EXT        : OFF
  --
  --   Protobuf compiler         : /usr/bin/protoc
  --   Protobuf includes         : /usr/include
  --   Protobuf libraries        : /usr/lib64/libprotobuf.so
  --   BUILD_ONNX_PYTHON         : ON
  --     Python version        :
  --     Python executable     : /usr/bin/python3
  --     Python includes       : /usr/include/python3.6m
  -- Configuring done
  -- Generating done
  -- Build files have been written to: /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build
  [  1%] Running gen_proto.py on onnx/onnx.in.proto
  [  2%] Building C object CMakeFiles/onnxifi_loader.dir/onnx/onnxifi_loader.c.o
  [  4%] Building C object CMakeFiles/onnxifi_dummy.dir/onnx/onnxifi_dummy.c.o
  [  5%] Linking C static library libonnxifi_loader.a
  Processing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/onnx/onnx.in.proto
  Writing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-ml.proto
  Writing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-ml.proto3
  generating /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx_pb.py
  [  7%] Linking C shared library libonnxifi_dummy.so
  [  8%] Running C++ protocol buffer compiler on /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-ml.proto
  [  8%] Built target onnxifi_dummy
  [  8%] Built target onnxifi_loader
  [  9%] Building C object CMakeFiles/onnxifi_wrapper.dir/onnx/onnxifi_wrapper.c.o
  [ 11%] Linking C shared module libonnxifi.so
  [ 11%] Built target onnxifi_wrapper
  Writing mypy to onnx/onnx_ml_pb2.pyi
  [ 11%] Built target gen_onnx_proto
  [ 12%] Running gen_proto.py on onnx/onnx-operators.in.proto
  [ 14%] Running gen_proto.py on onnx/onnx-data.in.proto
  Processing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/onnx/onnx-operators.in.proto
  Writing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-operators-ml.proto
  Writing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-operators-ml.proto3
  generating /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx_operators_pb.py
  Processing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/onnx/onnx-data.in.proto
  Writing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-data.proto
  Writing /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-data.proto3
  generating /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx_data_pb.py
  [ 16%] Running C++ protocol buffer compiler on /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-data.proto
  [ 16%] Running C++ protocol buffer compiler on /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-operators-ml.proto
  Writing mypy to onnx/onnx_data_pb2.pyi
  Writing mypy to onnx/onnx_operators_ml_pb2.pyi
  [ 16%] Built target gen_onnx_operators_proto
  [ 16%] Built target gen_onnx_data_proto
  [ 18%] Building CXX object CMakeFiles/onnx_proto.dir/onnx/onnx-ml.pb.cc.o
  [ 19%] Building CXX object CMakeFiles/onnx_proto.dir/onnx/onnx-operators-ml.pb.cc.o
  [ 21%] Building CXX object CMakeFiles/onnx_proto.dir/onnx/onnx-data.pb.cc.o
  In file included from /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-data.pb.cc:4:0:
  /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-data.pb.h:17:2: error: #error This file was generated by an older version of protoc which is
   #error This file was generated by an older version of protoc which is
    ^~~~~
  In file included from /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-operators-ml.pb.cc:4:0:
  /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-operators-ml.pb.h:17:2: error: #error This file was generated by an older version of protoc which is
   #error This file was generated by an older version of protoc which is
    ^~~~~
  /tmp/pip-install-vpn17m1g/onnx_58c50549dcbb43888cb76634cb6c4a2b/.setuptools-cmake-build/onnx/onnx-operators-ml.pb.h:18:2: error: #error incompatible with your Protocol Buffer headers. Please
   #error incompatible with your Protocol Buffer headers. Please
    ^~~~~

looks like onnx ver 1.12.0 is not compatible with our protobuf headers. Can we upgrade to 1.13.0 which I've tested? @kiritigowda

hansely avatar Mar 22 '24 11:03 hansely