Building Caffe with CUDA

[yolicap]

Hello, I am having an issue building Caffe with the instructions on DIGITS/docs/BuildCaffe.md after running the commands in order.

cd $CAFFE_ROOT
mkdir build
cd build
cmake ..
make -j"$(nproc)"
make install

My issue occurs when when I run make -j"$(nproc)" This is the full output:

[  1%] Running C++/Python protocol buffer compiler on /home/mehrdad/caffe/src/caffe/proto/caffe.proto
Scanning dependencies of target proto
[  1%] Building CXX object src/caffe/CMakeFiles/proto.dir/__/__/include/caffe/proto/caffe.pb.cc.o
[  1%] Linking CXX static library ../../lib/libproto.a
[  1%] Built target proto
[  1%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_absval_layer.cu.o
[  4%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/util/cuda_compile_1_generated_math_functions.cu.o
[  4%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_base_data_layer.cu.o
[  4%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/cuda_compile_1_generated_data_transformer.cu.o
[  4%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_batch_norm_layer.cu.o
[  4%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_batch_reindex_layer.cu.o
[  5%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_bnll_layer.cu.o
[  5%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_bias_layer.cu.o
[  5%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_concat_layer.cu.o
[  6%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_contrastive_loss_layer.cu.o
[  8%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_crop_layer.cu.o
[  8%] Building NVCC (Device) object src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_conv_layer.cu.o
nvcc fatal   : Unsupported gpu architecture 'compute_75'
CMake Error at cuda_compile_1_generated_math_functions.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/util/./cuda_compile_1_generated_math_functions.cu.o


nvcc fatal   : Unsupported gpu architecture 'compute_75'
CMake Error at cuda_compile_1_generated_base_data_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_base_data_layer.cu.o


nvcc fatal   : Unsupported gpu architecture 'compute_75'
src/caffe/CMakeFiles/caffe.dir/build.make:496: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/util/cuda_compile_1_generated_math_functions.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/util/cuda_compile_1_generated_math_functions.cu.o] Error 1
CMake Error at cuda_compile_1_generated_absval_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_absval_layer.cu.o


make[2]: *** Waiting for unfinished jobs....
src/caffe/CMakeFiles/caffe.dir/build.make:97: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_base_data_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_base_data_layer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
src/caffe/CMakeFiles/caffe.dir/build.make:90: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_absval_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_absval_layer.cu.o] Error 1
CMake Error at cuda_compile_1_generated_data_transformer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir//./cuda_compile_1_generated_data_transformer.cu.o


nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
nvcc fatal   : Unsupported gpu architecture 'compute_75'
CMake Error at cuda_compile_1_generated_bnll_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_bnll_layer.cu.o


nvcc fatal   : Unsupported gpu architecture 'compute_75'
src/caffe/CMakeFiles/caffe.dir/build.make:83: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/cuda_compile_1_generated_data_transformer.cu.o' failed
CMake Error at cuda_compile_1_generated_batch_reindex_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_batch_reindex_layer.cu.o

make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/cuda_compile_1_generated_data_transformer.cu.o] Error 1

nvcc fatal   : Unsupported gpu architecture 'compute_75'
CMake Error at cuda_compile_1_generated_contrastive_loss_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_contrastive_loss_layer.cu.o


CMake Error at cuda_compile_1_generated_bias_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_bias_layer.cu.o


CMake Error at cuda_compile_1_generated_batch_norm_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_batch_norm_layer.cu.o


nvcc fatal   : Unsupported gpu architecture 'compute_75'
src/caffe/CMakeFiles/caffe.dir/build.make:111: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_batch_reindex_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_batch_reindex_layer.cu.o] Error 1
src/caffe/CMakeFiles/caffe.dir/build.make:125: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_bnll_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_bnll_layer.cu.o] Error 1
src/caffe/CMakeFiles/caffe.dir/build.make:139: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_contrastive_loss_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_contrastive_loss_layer.cu.o] Error 1
CMake Error at cuda_compile_1_generated_crop_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_crop_layer.cu.o


src/caffe/CMakeFiles/caffe.dir/build.make:118: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_bias_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_bias_layer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
src/caffe/CMakeFiles/caffe.dir/build.make:104: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_batch_norm_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_batch_norm_layer.cu.o] Error 1
CMake Error at cuda_compile_1_generated_concat_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_concat_layer.cu.o


src/caffe/CMakeFiles/caffe.dir/build.make:153: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_crop_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_crop_layer.cu.o] Error 1
src/caffe/CMakeFiles/caffe.dir/build.make:132: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_concat_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_concat_layer.cu.o] Error 1
nvcc fatal   : Unsupported gpu architecture 'compute_75'
CMake Error at cuda_compile_1_generated_conv_layer.cu.o.Release.cmake:220 (message):
  Error generating
  /home/mehrdad/caffe/build/src/caffe/CMakeFiles/cuda_compile_1.dir/layers/./cuda_compile_1_generated_conv_layer.cu.o


src/caffe/CMakeFiles/caffe.dir/build.make:146: recipe for target 'src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_conv_layer.cu.o' failed
make[2]: *** [src/caffe/CMakeFiles/cuda_compile_1.dir/layers/cuda_compile_1_generated_conv_layer.cu.o] Error 1
CMakeFiles/Makefile2:401: recipe for target 'src/caffe/CMakeFiles/caffe.dir/all' failed
make[1]: *** [src/caffe/CMakeFiles/caffe.dir/all] Error 2
Makefile:149: recipe for target 'all' failed
make: *** [all] Error 2

I believe that make is trying to build using CUDA 9.1 and I don't think it supports the GPU that I am using which is 2080 Super. When I run nvcc --version this is my output:

 nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2017 NVIDIA Corporation
Built on Fri_Nov__3_21:07:56_CDT_2017
Cuda compilation tools, release 9.1, V9.1.85

But when I try to install CUDA 11.2 from this link: https://developer.nvidia.com/cuda-downloads?target_os=Linux&target_arch=x86_64&target_distro=Ubuntu&target_version=1804&target_type=debnetwork

I get a message saying that I already have CUDA 11.2 . Any ideas?

Thank you, Zeus

Update: I found out that I have multiple directories for cuda drivers in my /usr/local/ directory. I think it might be possible that when building, Make is looking for CUDA in the directory with 9.1 . I need to find a way to somehow redirect the make into my cuda-11.2 directory which has CUDA 11.2 drivers stored in. Any clue?