server Buiding without docker failed

Hi, I'm trying to build tritonserver without docker but it failed. Somebody help me please. 😢

Below is the Dockerfile to create an image to build inside:

ARG UBUNTU_VERSION=20.04
ARG CUDA=11.6
FROM nvidia/cuda:${CUDA}.2-base-ubuntu${UBUNTU_VERSION}

ARG CUDA
ARG CUDNN=8.4.1.50-1
ARG PYTHON_VERSION=3.7
ARG CUDNN_MAJOR_VERSION=8
ARG LIB_DIR_PREFIX=x86_64
ARG DEBIAN_FRONTEND=noninteractive

ENV \
    TZ=Asia/Seoul \
    SHELL=/bin/bash \
    PYTHONPATH=/usr/lib/python${PYTHON_VERSION}/site-packages \
    LD_LIBRARY_PATH=/usr/local/cuda/extras/CUPTI/lib64:/usr/local/cuda/lib64:/usr/include/x86_64-linux-gnu:/usr/lib/x86_64-linux-gnu:$LD_LIBRARY_PATH:/usr/local/cuda/lib64/stubs \
    TF_NEED_CUDA=1 \
    TF_CUDA_VERSION=${CUDA} \
    TF_CUDNN_VERSION=${CUDNN_MAJOR_VERSION}

SHELL ["/bin/bash", "-c"]
RUN apt-get update && apt-get install -y --no-install-recommends \
        build-essential \
        cuda-command-line-tools-${CUDA/./-} \
        libcublas-${CUDA/./-} \
        libcublas-dev-${CUDA/./-} \
        cuda-nvprune-${CUDA/./-} \
        cuda-nvrtc-${CUDA/./-} \
        cuda-nvrtc-dev-${CUDA/./-} \
        cuda-cudart-dev-${CUDA/./-} \
        libcufft-dev-${CUDA/./-} \
        libcurand-dev-${CUDA/./-} \
        libcusolver-dev-${CUDA/./-} \
        libcusparse-dev-${CUDA/./-} \
        libcudnn8=${CUDNN}+cuda${CUDA} \
        libcudnn8-dev=${CUDNN}+cuda${CUDA} \
        libcurl3-dev \
        libfreetype6-dev \
        libhdf5-serial-dev \
        libzmq3-dev \
        pkg-config \
        rsync \
        software-properties-common \
        unzip \
        zip \
        zlib1g-dev \
        wget \
        git \
        vim \
        nginx \
        supervisor \
        && \
    find /usr/local/cuda-${CUDA}/lib64/ -type f -name 'lib*_static.a' -not -name 'libcudart_static.a' -delete && \
    ln -s /usr/local/cuda/lib64/stubs/libcuda.so /usr/local/cuda/lib64/stubs/libcuda.so.1 && \
    echo "/usr/local/cuda/lib64/stubs" > /etc/ld.so.conf.d/z-cuda-stubs.conf && \
    ldconfig

# install python (from pytorch_lightning)
RUN add-apt-repository ppa:deadsnakes/ppa && \
    apt-get install -y \
        python${PYTHON_VERSION} \
        python${PYTHON_VERSION}-distutils \
        python${PYTHON_VERSION}-dev \
    && \

    update-alternatives --install /usr/bin/python${PYTHON_VERSION%%.*} python${PYTHON_VERSION%%.*} /usr/bin/python${PYTHON_VERSION} 1 && \
    update-alternatives --install /usr/bin/python python /usr/bin/python${PYTHON_VERSION} 1 && \

    apt-get autoremove -y && \
    apt-get clean && \
    rm -rf /root/.cache && \
    rm -rf /var/lib/apt/lists/*

RUN \
    wget https://bootstrap.pypa.io/get-pip.py --progress=bar:force:noscroll --no-check-certificate && \
    python${PYTHON_VERSION} get-pip.py && \
    rm get-pip.py

RUN \
    pip install --upgrade pip setuptools nbclassic && \
    pip install flask flask_cors uwsgi \
                pillow pandas jupyter jupyterlab jupyterlab_execute_time \
                pyyaml shap matplotlib \
                tensorflow==2.5 sklearn lightgbm h2o \
                seaborn xgboost && \
    pip install torch torchvision --extra-index-url https://download.pytorch.org/whl/cu116 && \
    echo "HISTTIMEFORMAT=\"%Y%m%d %H:%M:%S] \"" >> /etc/profile

COPY .jupyter /root/.jupyter

EXPOSE 80

# CMD ["/bin/bash", "-c", "jupyter notebook --ip '0.0.0.0' --port 80 --no-browser --allow-root --NotebookApp.token='' --NotebookApp.notebook_dir='/DEV' --LabApp.default_url='/lab?reset' --NotebookApp.terminado_settings='{"shell_command": ["/bin/bash"]}']

# ================================= From Dockerfile.buildbase =====================================================

# libcurl4-openSSL-dev is needed for GCS
# python3-dev is needed by Torchvision
# python3-pip and libarchive-dev is needed by python backend
# uuid-dev and pkg-config is needed for Azure Storage
# scons is needed for armnn_tflite backend build dep
RUN apt-get update && apt-get install -y --no-install-recommends \
    ca-certificates autoconf automake build-essential docker.io git libre2-dev libssl-dev libtool libboost-dev \
    libcurl4-openssl-dev libb64-dev patchelf python3-dev python3-pip python3-setuptools rapidjson-dev scons \
    software-properties-common unzip wget zlib1g-dev libarchive-dev pkg-config uuid-dev libnuma-dev curl \
    && rm -rf /var/lib/apt/lists/*

RUN pip3 install --upgrade pip && pip3 install --upgrade wheel setuptools docker

ENV TRITON_SERVER_VERSION=2.26.0dev
ENV NVIDIA_TRITON_SERVER_VERSION=22.09dev

RUN mkdir -p /opt/
RUN wget "https://repo.anaconda.com/miniconda/Miniconda3-py37_4.12.0-Linux-x86_64.sh" -O miniconda.sh -q &&     echo "4dc4214839c60b2f5eb3efbdee1ef5d9b45e74f2c09fcae6c8934a13f36ffc3e" "miniconda.sh" > shasum &&     sha256sum -c ./shasum &&     sh miniconda.sh -b -p /opt/conda &&     rm miniconda.sh shasum &&     find /opt/conda/ -follow -type f -name '*.a' -delete &&     find /opt/conda/ -follow -type f -name '*.js.map' -delete &&     /opt/conda/bin/conda clean -afy
ENV PATH /opt/conda/bin:${PATH}

ENV DCGM_VERSION=2.2.9

COPY cmake-3.21.1.tar.gz /
RUN tar xzvf cmake-3.21.1.tar.gz \
    && cd cmake-3.21.1 \
    && ./bootstrap && make && make install
    
RUN rm /etc/apt/sources.list.d/* \
    && apt-key del 7fa2af80 \ 
    && wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/cuda-keyring_1.0-1_all.deb \
    && dpkg -i cuda-keyring_1.0-1_all.deb \
    && apt-get update \
    && apt-get install -y datacenter-gpu-manager \
    && rm cuda-keyring_1.0-1_all.deb

# Server build requires recent version of CMake (FetchContent required)
#RUN wget -O - https://apt.kitware.com/keys/kitware-archive-latest.asc 2>/dev/null | gpg --dearmor - | tee /etc/apt/trusted.gpg.d/kitware.gpg >/dev/null \
#    && apt-add-repository 'deb https://apt.kitware.com/ubuntu/ focal main' \
#    && apt-get update && apt-get install -y --no-install-recommends \
#        cmake-data=3.21.1-0kitware1ubuntu20.04.1 cmake=3.21.1-0kitware1ubuntu20.04.1

## Install DCGM. Steps from https://developer.nvidia.com/dcgm#Downloads
#RUN curl -o /tmp/cuda-keyring.deb     https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/cuda-keyring_1.0-1_all.deb     && apt install /tmp/cuda-keyring.deb && rm /tmp/cuda-#keyring.deb &&     apt-get update && apt-get install -y datacenter-gpu-manager=1:2.2.9

In the container (run with --gpus=all --shm-size=32G), I installed the TensorRT with below commands:

tar xvzf TensorRT-8.2.5.1.Linux.x86_64-gnu.cuda-11.4.cudnn8.2.tar.gz
cd TensorRT-8.2.5.1
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$(pwd)/lib
pip install python/tensorrt-8.2.5.1-cp37-none-linux_x86_64.whl
pip install uff/uff-0.6.9-py2.py3-none-any.whl
pip install graphsurgeon/graphsurgeon-0.4.5-py2.py3-none-any.whl
pip install onnx_graphsurgeon/onnx_graphsurgeon-0.3.12-py2.py3-none-any.whl

Afterwards, I used below command to build tritonserver:

./build.py -v --no-container-build --build-dir=$(pwd)/build --enable-gpu --endpoint http --endpoint grpc --backend tensorflow2 --backend python --backend pytorch --backend fil --backend tensorrt --extra-core-cmake-arg j=0

And below is the error massage I met:

[ 91%] Performing build step for 'triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && make
make[3]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
/usr/local/bin/cmake -S/workspace/server/src -B/workspace/server/build/tritonserver/build/triton-server --check-build-system CMakeFiles/Makefile.cmake 0
/usr/local/bin/cmake -E cmake_progress_start /workspace/server/build/tritonserver/build/triton-server/CMakeFiles /workspace/server/build/tritonserver/build/triton-server//CMakeFiles/progress.marks
make  -f CMakeFiles/Makefile2 all
make[4]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f _deps/repo-core-build/CMakeFiles/triton-core-serverstub.dir/build.make _deps/repo-core-build/CMakeFiles/triton-core-serverstub.dir/depend
make  -f _deps/repo-common-build/CMakeFiles/triton-common-error.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-error.dir/depend
make  -f _deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/depend
make  -f _deps/repo-common-build/CMakeFiles/triton-common-logging.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-logging.dir/depend
make  -f _deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/build.make _deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/depend
make  -f _deps/repo-common-build/CMakeFiles/triton-common-thread-pool.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-thread-pool.dir/depend
make  -f _deps/repo-common-build/CMakeFiles/triton-common-table-printer.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-table-printer.dir/depend
make  -f _deps/repo-backend-build/CMakeFiles/kernel-library-new.dir/build.make _deps/repo-backend-build/CMakeFiles/kernel-library-new.dir/depend
make  -f test/CMakeFiles/data_compressor_test.dir/build.make test/CMakeFiles/data_compressor_test.dir/depend
make  -f test/CMakeFiles/caffe2plan.dir/build.make test/CMakeFiles/caffe2plan.dir/depend
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-core-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-core-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-core-build/CMakeFiles/triton-core-serverstub.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-error.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-logging.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-thread-pool.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-table-printer.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/src/test /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/test /workspace/server/build/tritonserver/build/triton-server/test/CMakeFiles/data_compressor_test.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/src/test /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/test /workspace/server/build/tritonserver/build/triton-server/test/CMakeFiles/caffe2plan.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-src/protobuf /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/protobuf /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build/CMakeFiles/kernel-library-new.dir/DependInfo.cmake --color=
Dependencies file "_deps/repo-core-build/CMakeFiles/triton-core-serverstub.dir/src/tritonserver_stub.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-core-build/CMakeFiles/triton-core-serverstub.dir/compiler_depend.internal".
Consolidate compiler generated dependencies of target triton-core-serverstub
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f _deps/repo-core-build/CMakeFiles/triton-core-serverstub.dir/build.make _deps/repo-core-build/CMakeFiles/triton-core-serverstub.dir/build
Dependencies file "_deps/repo-common-build/CMakeFiles/triton-common-logging.dir/src/logging.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-logging.dir/compiler_depend.internal".
Consolidate compiler generated dependencies of target triton-common-logging
Dependencies file "_deps/repo-common-build/CMakeFiles/triton-common-error.dir/src/error.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-error.dir/compiler_depend.internal".
Dependencies file "_deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/src/async_work_queue.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/compiler_depend.internal".
Consolidate compiler generated dependencies of target triton-common-error
Dependencies file "_deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/src/error.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/compiler_depend.internal".
Dependencies file "_deps/repo-common-build/CMakeFiles/triton-common-thread-pool.dir/src/thread_pool.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-thread-pool.dir/compiler_depend.internal".
Dependencies file "_deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/grpc_service.pb.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/compiler_depend.internal".
Dependencies file "_deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/src/thread_pool.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/compiler_depend.internal".
Consolidate compiler generated dependencies of target triton-common-async-work-queue
Consolidate compiler generated dependencies of target triton-common-thread-pool
Dependencies file "_deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/model_config.pb.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/compiler_depend.internal".
Consolidate compiler generated dependencies of target proto-library
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-core-build/CMakeFiles/triton-core-serverstub.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
Dependencies file "test/CMakeFiles/data_compressor_test.dir/data_compressor_test.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/test/CMakeFiles/data_compressor_test.dir/compiler_depend.internal".
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
Dependencies file "_deps/repo-common-build/CMakeFiles/triton-common-table-printer.dir/src/table_printer.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-table-printer.dir/compiler_depend.internal".
make  -f _deps/repo-common-build/CMakeFiles/triton-common-logging.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-logging.dir/build
make  -f _deps/repo-common-build/CMakeFiles/triton-common-error.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-error.dir/build
make  -f test/CMakeFiles/caffe2plan.dir/build.make test/CMakeFiles/caffe2plan.dir/build
Consolidate compiler generated dependencies of target data_compressor_test
Consolidate compiler generated dependencies of target triton-common-table-printer
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f _deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/build
make  -f _deps/repo-common-build/CMakeFiles/triton-common-thread-pool.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-thread-pool.dir/build
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f _deps/repo-backend-build/CMakeFiles/kernel-library-new.dir/build.make _deps/repo-backend-build/CMakeFiles/kernel-library-new.dir/build
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f _deps/repo-common-build/CMakeFiles/triton-common-table-printer.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-table-printer.dir/build
make  -f _deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/build.make _deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/build
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-common-build/CMakeFiles/triton-common-error.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f test/CMakeFiles/data_compressor_test.dir/build.make test/CMakeFiles/data_compressor_test.dir/build
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-common-build/CMakeFiles/triton-common-logging.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-common-build/CMakeFiles/triton-common-table-printer.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-backend-build/CMakeFiles/kernel-library-new.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
[  3%] Built target triton-core-serverstub
make[5]: Nothing to be done for '_deps/repo-common-build/CMakeFiles/triton-common-thread-pool.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-common-build/CMakeFiles/triton-common-async-work-queue.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f test/repoagent/relocation_repoagent/CMakeFiles/triton-relocation-repoagent.dir/build.make test/repoagent/relocation_repoagent/CMakeFiles/triton-relocation-repoagent.dir/depend
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-common-build/protobuf/CMakeFiles/proto-library.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/src/test/repoagent/relocation_repoagent /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/test/repoagent/relocation_repoagent /workspace/server/build/tritonserver/build/triton-server/test/repoagent/relocation_repoagent/CMakeFiles/triton-relocation-repoagent.dir/DependInfo.cmake --color=
make[5]: Nothing to be done for 'test/CMakeFiles/data_compressor_test.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
[  7%] Built target kernel-library-new
[  7%] Building CXX object test/CMakeFiles/caffe2plan.dir/caffe2plan.cc.o
cd /workspace/server/build/tritonserver/build/triton-server/test && /usr/bin/c++  -isystem /usr/local/cuda/include -O3 -DNDEBUG -MD -MT test/CMakeFiles/caffe2plan.dir/caffe2plan.cc.o -MF CMakeFiles/caffe2plan.dir/caffe2plan.cc.o.d -o CMakeFiles/caffe2plan.dir/caffe2plan.cc.o -c /workspace/server/src/test/caffe2plan.cc
[ 11%] Built target triton-common-error
[ 14%] Built target triton-common-table-printer
[ 17%] Built target triton-common-logging
make  -f CMakeFiles/http-endpoint-library.dir/build.make CMakeFiles/http-endpoint-library.dir/depend
[ 26%] Built target triton-common-async-work-queue
[ 31%] Built target proto-library
[ 33%] Built target triton-common-thread-pool
make  -f CMakeFiles/memory_alloc.dir/build.make CMakeFiles/memory_alloc.dir/depend
make  -f CMakeFiles/multi_server.dir/build.make CMakeFiles/multi_server.dir/depend
Dependencies file "test/repoagent/relocation_repoagent/CMakeFiles/triton-relocation-repoagent.dir/src/relocation.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/test/repoagent/relocation_repoagent/CMakeFiles/triton-relocation-repoagent.dir/compiler_depend.internal".
make  -f CMakeFiles/simple.dir/build.make CMakeFiles/simple.dir/depend
Consolidate compiler generated dependencies of target triton-relocation-repoagent
make  -f _deps/repo-common-build/protobuf/CMakeFiles/grpc-service-library.dir/build.make _deps/repo-common-build/protobuf/CMakeFiles/grpc-service-library.dir/depend
make  -f _deps/repo-common-build/CMakeFiles/triton-common-model-config.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-model-config.dir/depend
make  -f _deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/build.make _deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/depend
[ 36%] Built target data_compressor_test
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/CMakeFiles/http-endpoint-library.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-src/protobuf /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/protobuf /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/protobuf/CMakeFiles/grpc-service-library.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/CMakeFiles/memory_alloc.dir/DependInfo.cmake --color=
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f test/repoagent/relocation_repoagent/CMakeFiles/triton-relocation-repoagent.dir/build.make test/repoagent/relocation_repoagent/CMakeFiles/triton-relocation-repoagent.dir/build
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/CMakeFiles/multi_server.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/CMakeFiles/simple.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-model-config.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
cd /workspace/server/build/tritonserver/build/triton-server && /usr/local/bin/cmake -E cmake_depends "Unix Makefiles" /workspace/server/src /workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-src /workspace/server/build/tritonserver/build/triton-server /workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build /workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/DependInfo.cmake --color=
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for 'test/repoagent/relocation_repoagent/CMakeFiles/triton-relocation-repoagent.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
Dependencies file "CMakeFiles/simple.dir/simple.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/CMakeFiles/simple.dir/compiler_depend.internal".
Consolidate compiler generated dependencies of target simple
Dependencies file "CMakeFiles/http-endpoint-library.dir/http_server.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/CMakeFiles/http-endpoint-library.dir/compiler_depend.internal".
Dependencies file "_deps/repo-common-build/protobuf/CMakeFiles/grpc-service-library.dir/grpc_service.grpc.pb.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/protobuf/CMakeFiles/grpc-service-library.dir/compiler_depend.internal".
/workspace/server/src/test/caffe2plan.cc:27:10: fatal error: NvCaffeParser.h: No such file or directory
   27 | #include <NvCaffeParser.h>
      |          ^~~~~~~~~~~~~~~~~
compilation terminated.
Dependencies file "CMakeFiles/memory_alloc.dir/memory_alloc.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/CMakeFiles/memory_alloc.dir/compiler_depend.internal".
Consolidate compiler generated dependencies of target http-endpoint-library
Consolidate compiler generated dependencies of target grpc-service-library
Consolidate compiler generated dependencies of target memory_alloc
Dependencies file "_deps/repo-common-build/CMakeFiles/triton-common-model-config.dir/src/model_config.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-common-build/CMakeFiles/triton-common-model-config.dir/compiler_depend.internal".
Dependencies file "_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/src/backend_common.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/compiler_depend.internal".
make[5]: *** [test/CMakeFiles/caffe2plan.dir/build.make:76: test/CMakeFiles/caffe2plan.dir/caffe2plan.cc.o] Error 1
Dependencies file "CMakeFiles/multi_server.dir/multi_server.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/CMakeFiles/multi_server.dir/compiler_depend.internal".
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[4]: *** [CMakeFiles/Makefile2:841: test/CMakeFiles/caffe2plan.dir/all] Error 2
make[4]: *** Waiting for unfinished jobs....
make  -f CMakeFiles/simple.dir/build.make CMakeFiles/simple.dir/build
Dependencies file "_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/src/backend_input_collector.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/compiler_depend.internal".
Consolidate compiler generated dependencies of target triton-common-model-config
Consolidate compiler generated dependencies of target multi_server
Dependencies file "_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/src/backend_memory.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/compiler_depend.internal".
Dependencies file "_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/src/backend_model.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/compiler_depend.internal".
Dependencies file "_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/src/backend_model_instance.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/compiler_depend.internal".
Dependencies file "_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/src/backend_output_responder.cc.o.d" is newer than depends file "/workspace/server/build/tritonserver/build/triton-server/_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/compiler_depend.internal".
[ 39%] Built target triton-relocation-repoagent
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f CMakeFiles/memory_alloc.dir/build.make CMakeFiles/memory_alloc.dir/build
Consolidate compiler generated dependencies of target triton-backend-utils
make  -f CMakeFiles/http-endpoint-library.dir/build.make CMakeFiles/http-endpoint-library.dir/build
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f _deps/repo-common-build/protobuf/CMakeFiles/grpc-service-library.dir/build.make _deps/repo-common-build/protobuf/CMakeFiles/grpc-service-library.dir/build
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f CMakeFiles/multi_server.dir/build.make CMakeFiles/multi_server.dir/build
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f _deps/repo-common-build/CMakeFiles/triton-common-model-config.dir/build.make _deps/repo-common-build/CMakeFiles/triton-common-model-config.dir/build
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for 'CMakeFiles/http-endpoint-library.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for 'CMakeFiles/simple.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for 'CMakeFiles/multi_server.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for 'CMakeFiles/memory_alloc.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-common-build/protobuf/CMakeFiles/grpc-service-library.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make  -f _deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/build.make _deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/build
[ 42%] Built target simple
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-common-build/CMakeFiles/triton-common-model-config.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
[ 46%] Built target http-endpoint-library
[ 49%] Built target multi_server
make[5]: Entering directory '/workspace/server/build/tritonserver/build/triton-server'
make[5]: Nothing to be done for '_deps/repo-backend-build/CMakeFiles/triton-backend-utils.dir/build'.
make[5]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
[ 52%] Built target memory_alloc
[ 55%] Built target grpc-service-library
[ 58%] Built target triton-common-model-config
[ 69%] Built target triton-backend-utils
make[4]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[3]: *** [Makefile:136: all] Error 2
make[3]: Leaving directory '/workspace/server/build/tritonserver/build/triton-server'
make[2]: *** [CMakeFiles/triton-server.dir/build.make:86: triton-server/src/triton-server-stamp/triton-server-build] Error 2
make[2]: Leaving directory '/workspace/server/build/tritonserver/build'
make[1]: *** [CMakeFiles/Makefile2:140: CMakeFiles/triton-server.dir/all] Error 2
make[1]: Leaving directory '/workspace/server/build/tritonserver/build'
make: *** [Makefile:136: all] Error 2
error: build failed

p.s.) below shows some environments in the container:

root@9ea62ce3da4f:/workspace# nvidia-smi
Tue Aug 30 13:29:46 2022
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 470.74       Driver Version: 470.74       CUDA Version: 11.6     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  Tesla T4            Off  | 00000000:18:00.0 Off |                    0 |
| N/A   57C    P8    13W /  70W |      0MiB / 15109MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   1  Tesla T4            Off  | 00000000:5E:00.0 Off |                    0 |
| N/A   34C    P8    12W /  70W |      0MiB / 15109MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   2  Tesla T4            Off  | 00000000:86:00.0 Off |                    0 |
| N/A   36C    P8    11W /  70W |      0MiB / 15109MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   3  Tesla T4            Off  | 00000000:AF:00.0 Off |                    0 |
| N/A   36C    P8    12W /  70W |      0MiB / 15109MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+
root@9ea62ce3da4f:/workspace# nvcc -V
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Tue_Mar__8_18:18:20_PST_2022
Cuda compilation tools, release 11.6, V11.6.124
Build cuda_11.6.r11.6/compiler.31057947_0
root@9ea62ce3da4f:/workspace# cat /etc/issue
Ubuntu 20.04.4 LTS \n \l

root@9ea62ce3da4f:/workspace# arch
x86_64

Aug 30 '22 04:08 kangsan0420

I found that TensorRT makes the error. What is the right way to install TensorRT to build tritonserver without docker?

Aug 30 '22 08:08 kangsan0420

Hi @kangsan0420, I see you are attempting to use Triton release 22.09dev. This is considered an internal development branch which may not be stable. Our r22.08 branch is our latest stable release. Could you please update the release version and confirm you are seeing the same issue?

Aug 30 '22 16:08 nv-kmcgill53

Thank you @nv-kmcgill53. I tried but I'm still struggling to build including TensorRT. It is not working even with: ./build.py -v --no-container-build --build-dir=$(pwd)/build --backend tensorrt. What TensorRT version is tested for tritonserver r22.08 or r22.07? The Python version has to be fixed to 3.7 & CUDA 11.6 & cuDNN 8.4

Aug 31 '22 04:08 kangsan0420

To help unblock you, if you don't need the caffee2plan executable built to convert any models and this is the only compilation issue you are facing, then you can simply comment out the cmake build directive.

It could also be the case that the header files which came with TensorRT were not installed correctly. You can check that you have the NvCaffeParser.h file on your system and that it is installed in the appropriate include directory.

Aug 31 '22 23:08 nv-kmcgill53

I think that NvCaffeParser.h is on right directory.

root@1fd325a72c07:/workspace# ll TensorRT-8.4.1.5/
total 8
drwxr-xr-x 11 root root  166 Jun  4 07:15 ./
drwxr-xr-x  7 1002 1002  111 Sep  1 10:49 ../
lrwxrwxrwx  1 root root   28 Jun  4 07:09 bin -> targets/x86_64-linux-gnu/bin/
drwxr-xr-x  9 root root  114 Jun  4 07:15 data/
drwxr-xr-x  4 root root   77 Sep  1 11:07 doc/
drwxr-xr-x  2 root root   53 Jun  4 07:09 graphsurgeon/
drwxr-xr-x  2 root root 4096 Sep  1 11:07 include/
lrwxrwxrwx  1 root root   28 Jun  4 07:09 lib -> targets/x86_64-linux-gnu/lib/
drwxr-xr-x  2 root root   59 Jun  4 07:09 onnx_graphsurgeon/
drwxr-xr-x  2 root root  262 Jun  4 07:10 python/
drwxr-xr-x 23 root root 4096 Jun  4 07:14 samples/
drwxr-xr-x  3 root root   30 Jun  4 07:15 targets/
drwxr-xr-x  2 root root   44 Jun  4 07:09 uff/

root@1fd325a72c07:/workspace# ll TensorRT-8.4.1.5/include/
total 644
drwxr-xr-x  2 root root   4096 Sep  1 11:07 ./
drwxr-xr-x 11 root root    166 Jun  4 07:15 ../
-rw-r--r--  1 root root   9387 Jun  4 07:14 NvCaffeParser.h
-rw-r--r--  1 root root 301936 Jun  4 07:14 NvInfer.h
-rw-r--r--  1 root root   4526 Jun  4 07:14 NvInferConsistency.h
-rw-r--r--  1 root root   1167 Jun  4 07:14 NvInferConsistencyImpl.h
-rw-r--r--  1 root root  44492 Jun  4 07:14 NvInferImpl.h
-rw-r--r--  1 root root   3563 Jun  4 07:14 NvInferLegacyDims.h
-rw-r--r--  1 root root   9392 Jun  4 07:14 NvInferPlugin.h
-rw-r--r--  1 root root   9884 Jun  4 07:14 NvInferPluginUtils.h
-rw-r--r--  1 root root 108016 Jun  4 07:14 NvInferRuntime.h
-rw-r--r--  1 root root  76570 Jun  4 07:14 NvInferRuntimeCommon.h
-rw-r--r--  1 root root  22172 Jun  4 07:14 NvInferSafeRuntime.h
-rw-r--r--  1 root root   1404 Jun  4 07:14 NvInferVersion.h
-rw-r--r--  1 root root   5910 Jun  4 07:14 NvOnnxConfig.h
-rw-r--r--  1 root root   8496 Jun  4 07:08 NvOnnxParser.h
-rw-r--r--  1 root root   6781 Jun  4 07:14 NvUffParser.h
-rw-r--r--  1 root root   5239 Jun  4 07:14 NvUtils.h

In order to install TensorRT, I followed this instruction. Isn't enough to set export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:${TensorRT directory}/lib? I also tried belows but no one works. export PATH=$PATH:${TensorRT directory}/bin export PATH=$PATH:${TensorRT directory}/include cp ${TensorRT directory}/include/* /usr/include What should I do to install TensorRT correctly?

: Installing TensorRT-8.4.1.5 for tritonserver r22.08 on : CUDA-11.6.124 cuDNN-8.4.1.50-1 Python-3.7.13

Sep 01 '22 05:09 kangsan0420

sampe problem ...

Sep 02 '22 09:09 Willert98

Triton does not a reliable way to do a dockerless build you can try manually going into the build step and see the actual build errors and resolve them. The docker build output from build.py is not providing enough information

That being said... closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this issue

Nov 22 '22 03:11 jbkyang-nvi

same problem

Aug 28 '23 06:08 LuLu2kANG

same problem, how to fix?

Jan 17 '24 13:01 zhaohb

I have fixed this problem, now tensorrt no longer supports caffe to plan, just need to make the following changes to the normal compilation:

diff --git a/src/test/CMakeLists.txt b/src/test/CMakeLists.txt
index 25049624..f61e3334 100644
--- a/src/test/CMakeLists.txt
+++ b/src/test/CMakeLists.txt
@@ -31,25 +31,25 @@ cmake_minimum_required (VERSION 3.18)
 #
 find_package(GTest REQUIRED)

+##
+## caffe2plan
+##
+#if(${TRITON_ENABLE_TENSORRT})
+#  add_executable(caffe2plan caffe2plan.cc)
+#  target_include_directories(caffe2plan PRIVATE ${CUDA_INCLUDE_DIRS})
+#  target_link_libraries(
+#    caffe2plan
+#    PRIVATE
+#      -lnvinfer
+#      -lnvcaffe_parser
+#      CUDA::cudart
+#  )
 #
-# caffe2plan
-#
-if(${TRITON_ENABLE_TENSORRT})
-  add_executable(caffe2plan caffe2plan.cc)
-  target_include_directories(caffe2plan PRIVATE ${CUDA_INCLUDE_DIRS})
-  target_link_libraries(
-    caffe2plan
-    PRIVATE
-      -lnvinfer
-      -lnvcaffe_parser
-      CUDA::cudart
-  )
-
-  install(
-    TARGETS caffe2plan
-    RUNTIME DESTINATION bin
-  )
-endif() # TRITON_ENABLE_TENSORRT
+#  install(
+#    TARGETS caffe2plan
+#    RUNTIME DESTINATION bin
+#  )
+#endif() # TRITON_ENABLE_TENSORRT

 #
 # Unit test for DataCompressor

Jan 19 '24 07:01 zhaohb

server server copied to clipboard

Buiding without docker failed

server
server copied to clipboard