flownet2-tf icon indicating copy to clipboard operation
flownet2-tf copied to clipboard

nvcc not found

Open lovekittynine opened this issue 5 years ago • 16 comments

lovekittynine avatar Jan 03 '19 07:01 lovekittynine

Install CUDA Toolkit.

Iamanorange avatar Jan 03 '19 07:01 Iamanorange

/bin/sh: 1: nvcc: not found I have met this problem,but i have installed cuda-toolkit9.0 and i run nvcc -V shows " Cuda compilation tools, release 9.0, V9.0.176"

lovekittynine avatar Jan 03 '19 07:01 lovekittynine

Edit Makefile: change GPUCC = nvcc to GPUCC = path/to/nvcc. or Use your current shell to run make.

Iamanorange avatar Jan 03 '19 07:01 Iamanorange

thanks very much! i have changed nvcc path,and it works.But i have met another problem. 5 errors detected in the compilation of "/tmp/tmpxft_00006e0d_00000000-6_data_augmentation.cu.cpp1.ii".

lovekittynine avatar Jan 04 '19 08:01 lovekittynine

Paste full error log.

Iamanorange avatar Jan 04 '19 08:01 Iamanorange

detected during: instantiation of "Scalar Eigen::internal::igamma_series_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::VALUE]" (863): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::VALUE]" (2096): here instantiation of "Eigen::internal::igamma_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::igamma(const Scalar &, const Scalar &) [with Scalar=float]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsHalf.h(34): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(651): warning: missing return statement at end of non-void function "Eigen::internal::igammac_cf_impl<Scalar, mode>::run [with Scalar=float, mode=Eigen::internal::DERIVATIVE]" detected during: instantiation of "Scalar Eigen::internal::igammac_cf_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::DERIVATIVE]" (855): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::DERIVATIVE]" (2102): here instantiation of "Eigen::internal::igamma_der_a_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::igamma_der_a(const Scalar &, const Scalar &) [with Scalar=float]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsHalf.h(38): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(712): warning: missing return statement at end of non-void function "Eigen::internal::igamma_series_impl<Scalar, mode>::run [with Scalar=float, mode=Eigen::internal::DERIVATIVE]" detected during: instantiation of "Scalar Eigen::internal::igamma_series_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::DERIVATIVE]" (863): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::DERIVATIVE]" (2102): here instantiation of "Eigen::internal::igamma_der_a_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::igamma_der_a(const Scalar &, const Scalar &) [with Scalar=float]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsHalf.h(38): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(651): warning: missing return statement at end of non-void function "Eigen::internal::igammac_cf_impl<Scalar, mode>::run [with Scalar=float, mode=Eigen::internal::SAMPLE_DERIVATIVE]" detected during: instantiation of "Scalar Eigen::internal::igammac_cf_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::SAMPLE_DERIVATIVE]" (855): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::SAMPLE_DERIVATIVE]" (2108): here instantiation of "Eigen::internal::gamma_sample_der_alpha_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::gamma_sample_der_alpha(const Scalar &, const Scalar &) [with Scalar=float]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsHalf.h(42): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(712): warning: missing return statement at end of non-void function "Eigen::internal::igamma_series_impl<Scalar, mode>::run [with Scalar=float, mode=Eigen::internal::SAMPLE_DERIVATIVE]" detected during: instantiation of "Scalar Eigen::internal::igamma_series_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::SAMPLE_DERIVATIVE]" (863): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=float, mode=Eigen::internal::SAMPLE_DERIVATIVE]" (2108): here instantiation of "Eigen::internal::gamma_sample_der_alpha_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::gamma_sample_der_alpha(const Scalar &, const Scalar &) [with Scalar=float]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsHalf.h(42): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(651): warning: missing return statement at end of non-void function "Eigen::internal::igammac_cf_impl<Scalar, mode>::run [with Scalar=double, mode=Eigen::internal::VALUE]" detected during: instantiation of "Scalar Eigen::internal::igammac_cf_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::VALUE]" (855): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::VALUE]" (2096): here instantiation of "Eigen::internal::igamma_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::igamma(const Scalar &, const Scalar &) [with Scalar=double]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/arch/CUDA/CudaSpecialFunctions.h(120): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(712): warning: missing return statement at end of non-void function "Eigen::internal::igamma_series_impl<Scalar, mode>::run [with Scalar=double, mode=Eigen::internal::VALUE]" detected during: instantiation of "Scalar Eigen::internal::igamma_series_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::VALUE]" (863): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::VALUE]" (2096): here instantiation of "Eigen::internal::igamma_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::igamma(const Scalar &, const Scalar &) [with Scalar=double]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/arch/CUDA/CudaSpecialFunctions.h(120): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(651): warning: missing return statement at end of non-void function "Eigen::internal::igammac_cf_impl<Scalar, mode>::run [with Scalar=double, mode=Eigen::internal::DERIVATIVE]" detected during: instantiation of "Scalar Eigen::internal::igammac_cf_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::DERIVATIVE]" (855): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::DERIVATIVE]" (2102): here instantiation of "Eigen::internal::igamma_der_a_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::igamma_der_a(const Scalar &, const Scalar &) [with Scalar=double]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/arch/CUDA/CudaSpecialFunctions.h(135): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(712): warning: missing return statement at end of non-void function "Eigen::internal::igamma_series_impl<Scalar, mode>::run [with Scalar=double, mode=Eigen::internal::DERIVATIVE]" detected during: instantiation of "Scalar Eigen::internal::igamma_series_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::DERIVATIVE]" (863): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::DERIVATIVE]" (2102): here instantiation of "Eigen::internal::igamma_der_a_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::igamma_der_a(const Scalar &, const Scalar &) [with Scalar=double]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/arch/CUDA/CudaSpecialFunctions.h(135): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(651): warning: missing return statement at end of non-void function "Eigen::internal::igammac_cf_impl<Scalar, mode>::run [with Scalar=double, mode=Eigen::internal::SAMPLE_DERIVATIVE]" detected during: instantiation of "Scalar Eigen::internal::igammac_cf_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::SAMPLE_DERIVATIVE]" (855): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::SAMPLE_DERIVATIVE]" (2108): here instantiation of "Eigen::internal::gamma_sample_der_alpha_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::gamma_sample_der_alpha(const Scalar &, const Scalar &) [with Scalar=double]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/arch/CUDA/CudaSpecialFunctions.h(154): here

/usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/SpecialFunctionsImpl.h(712): warning: missing return statement at end of non-void function "Eigen::internal::igamma_series_impl<Scalar, mode>::run [with Scalar=double, mode=Eigen::internal::SAMPLE_DERIVATIVE]" detected during: instantiation of "Scalar Eigen::internal::igamma_series_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::SAMPLE_DERIVATIVE]" (863): here instantiation of "Scalar Eigen::internal::igamma_generic_impl<Scalar, mode>::run(Scalar, Scalar) [with Scalar=double, mode=Eigen::internal::SAMPLE_DERIVATIVE]" (2108): here instantiation of "Eigen::internal::gamma_sample_der_alpha_retval<Eigen::internal::global_math_functions_filtering_base<Scalar, void>::type>::type Eigen::numext::gamma_sample_der_alpha(const Scalar &, const Scalar &) [with Scalar=double]" /usr/local/lib/python3.6/dist-packages/tensorflow/include/unsupported/Eigen/CXX11/../src/SpecialFunctions/arch/CUDA/CudaSpecialFunctions.h(154): here

1 error detected in the compilation of "/tmp/tmpxft_0000811d_00000000-6_data_augmentation.cu.cpp1.ii". Makefile:62: recipe for target 'preprocessing' failed make: *** [preprocessing] Error 1

lovekittynine avatar Jan 04 '19 08:01 lovekittynine

Can't find anything useful. More information about your environment and operation?

Iamanorange avatar Jan 04 '19 18:01 Iamanorange

ubuntu18.04 cuda9.0 tensorflow1.12

lovekittynine avatar Jan 05 '19 03:01 lovekittynine

It's this problem solved? I met a similar problem

4 errors detected in the compilation of "/tmp/tmpxft_000071e7_00000000-6_data_augmentation.cu.cpp1.ii". Makefile:62: recipe for target 'preprocessing' failed make: *** [preprocessing] Error 1

haleqiu avatar Apr 25 '19 07:04 haleqiu

The error message is printed before xx errors detected in xxxxxx. Please paste it.

Iamanorange avatar Apr 25 '19 07:04 Iamanorange

@Iamanorange based on the previous post, I change the makefile to F_INC = python -c "import tensorflow; print(tensorflow.sysconfig.get_include())"`

ifndef CUDA_HOME CUDA_HOME := /usr/local/cuda endif

CC = gcc -O2 -pthread CXX = g++ GPUCC = nvcc --expt-relaxed-constexpr CFLAGS = -std=c++11 -I$(TF_INC) -I"$(CUDA_HOME)/.." -DGOOGLE_CUDA=1 GPUCFLAGS = -c LFLAGS = -pthread -shared -fPIC GPULFLAGS = -x cu -Xcompiler -fPIC CGPUFLAGS = -L$(CUDA_HOME)/lib -L$(CUDA_HOME)/lib64 -lcudart

OUT_DIR = src/ops/build PREPROCESSING_SRC = "src/ops/preprocessing/preprocessing.cc" "src/ops/preprocessing/kernels/flow_augmentation.cc" "src/ops/preprocessing/kernels/augmentation_base.cc" "src/ops/preprocessing/kernels/data_augmentation.cc" GPU_SRC_DATA_AUG = src/ops/preprocessing/kernels/data_augmentation.cu.cc GPU_SRC_FLOW = src/ops/preprocessing/kernels/flow_augmentation_gpu.cu.cc GPU_PROD_DATA_AUG = $(OUT_DIR)/data_augmentation.o GPU_PROD_FLOW = $(OUT_DIR)/flow_augmentation_gpu.o PREPROCESSING_PROD = $(OUT_DIR)/preprocessing.so

DOWNSAMPLE_SRC = "src/ops/downsample/downsample_kernel.cc" "src/ops/downsample/downsample_op.cc" GPU_SRC_DOWNSAMPLE = src/ops/downsample/downsample_kernel_gpu.cu.cc GPU_PROD_DOWNSAMPLE = $(OUT_DIR)/downsample_kernel_gpu.o DOWNSAMPLE_PROD = $(OUT_DIR)/downsample.so

CORRELATION_SRC = "src/ops/correlation/correlation_kernel.cc" "src/ops/correlation/correlation_grad_kernel.cc" "src/ops/correlation/correlation_op.cc" GPU_SRC_CORRELATION = src/ops/correlation/correlation_kernel.cu.cc GPU_SRC_CORRELATION_GRAD = src/ops/correlation/correlation_grad_kernel.cu.cc GPU_SRC_PAD = src/ops/correlation/pad.cu.cc GPU_PROD_CORRELATION = $(OUT_DIR)/correlation_kernel_gpu.o GPU_PROD_CORRELATION_GRAD = $(OUT_DIR)/correlation_grad_kernel_gpu.o GPU_PROD_PAD = $(OUT_DIR)/correlation_pad_gpu.o CORRELATION_PROD = $(OUT_DIR)/correlation.so`

the error in make all seems to be solved, no error message detected But a new error generated with python -m src.flownet2.test --input_a data/samples/0img0.ppm --input_b data/samples/0img1.ppm --out ./

Traceback (most recent call last): File "/home/groupxghan/cv/.conda/envs/flow-tf/lib/python2.7/runpy.py", line 174, in _run_module_as_main "main", fname, loader, pkg_name) File "/home/groupxghan/cv/.conda/envs/flow-tf/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/home/groupxghan/cv/haleqiu/FLOWNET/flownet2-tf/src/flownet2/test.py", line 4, in from .flownet2 import FlowNet2 File "src/flownet2/flownet2.py", line 2, in from ..flownet_css.flownet_css import FlowNetCSS File "src/flownet_css/flownet_css.py", line 2, in from ..flownet_cs.flownet_cs import FlowNetCS File "src/flownet_cs/flownet_cs.py", line 2, in from ..flownet_c.flownet_c import FlowNetC File "src/flownet_c/flownet_c.py", line 3, in from ..correlation import correlation File "src/correlation.py", line 4, in tf.resource_loader.get_path_to_datafile("./ops/build/correlation.so")) File "/home/groupxghan/cv/.conda/envs/flow-tf/lib/python2.7/site-packages/tensorflow/python/framework/load_library.py", line 56, in load_op_library lib_handle = py_tf.TF_LoadLibrary(library_filename) tensorflow.python.framework.errors_impl.NotFoundError: src/./ops/build/correlation.so: undefined symbol: _ZTIN10tensorflow8OpKernelE

haleqiu avatar Apr 25 '19 07:04 haleqiu

https://github.com/sampepose/flownet2-tf/issues/28#issuecomment-406941839

Iamanorange avatar Apr 25 '19 07:04 Iamanorange

Modify Makefile: TF_LIB = python -c "import tensorflow; print(tensorflow.sysconfig.get_lib())" CGPUFLAGS = -L$(CUDA_HOME)/lib -L$(CUDA_HOME)/lib64 -lcudart -L$(TF_LIB) -ltensorflow_framework

I do the make file again.

Traceback (most recent call last): File "/home/groupxghan/cv/.conda/envs/flow-tf/lib/python2.7/runpy.py", line 174, in _run_module_as_main "main", fname, loader, pkg_name) File "/home/groupxghan/cv/.conda/envs/flow-tf/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/home/groupxghan/cv/haleqiu/FLOWNET/flownet2-tf/src/flownet2/test.py", line 4, in from .flownet2 import FlowNet2 File "src/flownet2/flownet2.py", line 2, in from ..flownet_css.flownet_css import FlowNetCSS File "src/flownet_css/flownet_css.py", line 2, in from ..flownet_cs.flownet_cs import FlowNetCS File "src/flownet_cs/flownet_cs.py", line 2, in from ..flownet_c.flownet_c import FlowNetC File "src/flownet_c/flownet_c.py", line 3, in from ..correlation import correlation File "src/correlation.py", line 4, in tf.resource_loader.get_path_to_datafile("./ops/build/correlation.so")) File "/home/groupxghan/cv/.conda/envs/flow-tf/lib/python2.7/site-packages/tensorflow/python/framework/load_library.py", line 56, in load_op_library lib_handle = py_tf.TF_LoadLibrary(library_filename) tensorflow.python.framework.errors_impl.NotFoundError: src/./ops/build/correlation.so: undefined symbol: _ZN10tensorflow8internal21CheckOpMessageBuilder9NewStringEv

haleqiu avatar Apr 25 '19 07:04 haleqiu

https://github.com/sampepose/flownet2-tf/issues/28#issuecomment-441118569

Iamanorange avatar Apr 25 '19 07:04 Iamanorange

Search carefully before file an issue.

Iamanorange avatar Apr 25 '19 07:04 Iamanorange

Thanks a lot! I have solved this problem. I will be careful next time !!!!

haleqiu avatar Apr 25 '19 07:04 haleqiu