seg_every_thing icon indicating copy to clipboard operation
seg_every_thing copied to clipboard

Dockerfile error:

Open satish1901 opened this issue 5 years ago • 0 comments

i am getting the following issue when i am trying to run the following command COMMAND :
nvidia-docker run --rm -it 5de59a4a77bd python2 tools/train_net.py --multi-gpu-testing --cfg configs/getting_started/tutorial_2gpu_e2e_faster_rcnn_R-50-FPN.yaml OUTPUT_DIR /tmp/detectron-output

ERROR : satish@vader:~/Revision/DETECTRON/seg_every_thing$ nvidia-docker run --rm -it 5de59a4a77bd python2 tools/train_net.py --multi-gpu-testing --cfg configs/getting_started/tutorial_2gpu_e2e_faster_rcnn_R-50-FPN.yaml OUTPUT_DIR /tmp/detectron-output Found Detectron ops lib: /usr/local/caffe2_build/lib/libcaffe2_detectron_ops_gpu.so E0929 00:50:01.726465 1 init_intrinsics_check.cc:54] CPU feature avx is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0929 00:50:01.726497 1 init_intrinsics_check.cc:54] CPU feature avx2 is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. E0929 00:50:01.726505 1 init_intrinsics_check.cc:54] CPU feature fma is present on your machine, but the Caffe2 binary is not compiled with it. It means you may not get the full speed of your CPU. INFO train_net.py: 95: Called with args: INFO train_net.py: 96: Namespace(cfg_file='configs/getting_started/tutorial_2gpu_e2e_faster_rcnn_R-50-FPN.yaml', multi_gpu_testing=True, opts=['OUTPUT_DIR', '/tmp/detectron-output'], skip_test=False) /detectron/lib/core/config.py:1090: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. yaml_cfg = AttrDict(yaml.load(f)) INFO io.py: 67: Downloading remote file https://s3-us-west-2.amazonaws.com/detectron/ImageNetPretrained/MSRA/R-50.pkl to /tmp/detectron-download-cache/ImageNetPretrained/MSRA/R-50.pkl Traceback (most recent call last): File "tools/train_net.py", line 128, in main() File "tools/train_net.py", line 101, in main assert_and_infer_cfg() File "/detectron/lib/core/config.py", line 1054, in assert_and_infer_cfg cache_cfg_urls() File "/detectron/lib/core/config.py", line 1063, in cache_cfg_urls __C.TRAIN.WEIGHTS = cache_url(__C.TRAIN.WEIGHTS, __C.DOWNLOAD_CACHE) File "/detectron/lib/utils/io.py", line 68, in cache_url download_url(url, cache_file_path) File "/detectron/lib/utils/io.py", line 114, in download_url response = urllib2.urlopen(url) File "/usr/lib/python2.7/urllib2.py", line 154, in urlopen return opener.open(url, data, timeout) File "/usr/lib/python2.7/urllib2.py", line 435, in open response = meth(req, response) File "/usr/lib/python2.7/urllib2.py", line 548, in http_response 'http', request, response, code, msg, hdrs) File "/usr/lib/python2.7/urllib2.py", line 473, in error return self._call_chain(*args) File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain result = func(*args) File "/usr/lib/python2.7/urllib2.py", line 556, in http_error_default raise HTTPError(req.get_full_url(), code, msg, hdrs, fp) urllib2.HTTPError: HTTP Error 301: Moved Permanently

I even changed the url in lib. utils io.py from : https://s3-us-west-2.amazonaws.com/detectron/ImageNetPretrained/MSRA/R-50.pkl to : https://dl.fbaipublicfiles.com/detectron/ImageNetPretrained/MSRA/R-50.pkl

But still detectron is some how pulling the cached url

Then to fix this i pulled the latest github repo of detectron with the updated "url". But after the as mentioned in the other issue.

"RUN make ops " fails in the dockerfile with the below error Can you please suggest the fix or work around :

Step 13/13 : RUN make ops ---> Running in cfe37fc1b57b mkdir -p build && cd build && cmake .. && make -j28 -- The C compiler identification is GNU 5.4.0 -- The CXX compiler identification is GNU 5.4.0 -- Check for working C compiler: /usr/bin/cc -- Check for working C compiler: /usr/bin/cc -- works -- Detecting C compiler ABI info -- Detecting C compiler ABI info - done -- Detecting C compile features -- Detecting C compile features - done -- Check for working CXX compiler: /usr/bin/c++ -- Check for working CXX compiler: /usr/bin/c++ -- works -- Detecting CXX compiler ABI info -- Detecting CXX compiler ABI info - done -- Detecting CXX compile features -- Detecting CXX compile features - done -- Cannot find gflags with config files. Using legacy find. CMake Warning at /usr/local/caffe2_build/share/cmake/Caffe2/public/gflags.cmake:2 (find_package): By not providing "Findgflags.cmake" in CMAKE_MODULE_PATH this project has asked CMake to find a package configuration file provided by "gflags", but CMake did not find one.

Could not find a package configuration file provided by "gflags" with any of the following names:

gflagsConfig.cmake
gflags-config.cmake

Add the installation prefix of "gflags" to CMAKE_PREFIX_PATH or set "gflags_DIR" to a directory containing one of the above files. If "gflags" provides a separate development package or SDK, be sure it has been installed. Call Stack (most recent call first): /usr/local/caffe2_build/share/cmake/Caffe2/Caffe2Config.cmake:16 (include) CMakeLists.txt:8 (find_package)

-- Found gflags: /usr/include -- Found gflags (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libgflags.so) -- Cannot find glog. Using legacy find. CMake Warning at /usr/local/caffe2_build/share/cmake/Caffe2/public/glog.cmake:2 (find_package): By not providing "Findglog.cmake" in CMAKE_MODULE_PATH this project has asked CMake to find a package configuration file provided by "glog", but CMake did not find one.

Could not find a package configuration file provided by "glog" with any of the following names:

glogConfig.cmake
glog-config.cmake

Add the installation prefix of "glog" to CMAKE_PREFIX_PATH or set "glog_DIR" to a directory containing one of the above files. If "glog" provides a separate development package or SDK, be sure it has been installed. Call Stack (most recent call first): /usr/local/caffe2_build/share/cmake/Caffe2/Caffe2Config.cmake:30 (include) CMakeLists.txt:8 (find_package)

-- Found glog: /usr/include CMake Warning at CMakeLists.txt:13 (message): You are using an older version of Caffe2 (version 0.8.1). Please consider moving to a newer version.

-- Looking for pthread.h -- Looking for pthread.h - found -- Looking for pthread_create -- Looking for pthread_create - not found -- Looking for pthread_create in pthreads -- Looking for pthread_create in pthreads - not found -- Looking for pthread_create in pthread -- Looking for pthread_create in pthread - found -- Found Threads: TRUE -- CUDA detected: 9.0 -- Added CUDA NVCC flags for: sm_30 sm_35 sm_50 sm_52 sm_60 sm_61 sm_70 -- Found libcuda: /usr/local/cuda/lib64/stubs/libcuda.so -- Found libnvrtc: /usr/local/cuda/lib64/libnvrtc.so -- Found CUDNN: /usr/include -- Found cuDNN: v7.0.5 (include: /usr/include, library: /usr/lib/x86_64-linux-gnu/libcudnn.so) -- Summary: -- CMake version : 3.5.1 -- CMake command : /usr/bin/cmake -- System name : Linux -- C++ compiler : /usr/bin/c++ -- C++ compiler version : 5.4.0 -- CXX flags : -std=c++11 -O2 -fPIC -Wno-narrowing -- Caffe2 version : 0.8.1 -- Caffe2 include path : /usr/local/caffe2_build/include -- Have CUDA : TRUE -- CUDA version : 9.0 -- CuDNN version : 7.0.5 -- Configuring done -- Generating done -- Build files have been written to: /detectron/build make[1]: Entering directory '/detectron/build' make[2]: Entering directory '/detectron/build' make[3]: Entering directory '/detectron/build' make[3]: Entering directory '/detectron/build' [ 20%] Building NVCC (Device) object CMakeFiles/caffe2_detectron_custom_ops_gpu.dir/detectron/ops/caffe2_detectron_custom_ops_gpu_generated_zero_even_op.cu.o Scanning dependencies of target caffe2_detectron_custom_ops make[3]: Leaving directory '/detectron/build' make[3]: Entering directory '/detectron/build' [ 40%] Building CXX object CMakeFiles/caffe2_detectron_custom_ops.dir/detectron/ops/zero_even_op.cc.o In file included from /usr/local/caffe2_build/include/caffe2/core/allocator.h:22:0, from /usr/local/caffe2_build/include/caffe2/core/context.h:25, from /detectron/detectron/ops/zero_even_op.h:20, from /detectron/detectron/ops/zero_even_op.cc:17: /detectron/detectron/ops/zero_even_op.cc: In member function 'bool caffe2::ZeroEvenOp<T, Context>::RunOnDevice() [with T = float; Context = caffe2::CPUContext]': /detectron/detectron/ops/zero_even_op.cc:25:23: error: no matching function for call to 'caffe2::Tensorcaffe2::CPUContext::dim() const' CAFFE_ENFORCE(X.dim() == 1); ^ In file included from /usr/local/caffe2_build/include/caffe2/core/net.h:34:0, from /usr/local/caffe2_build/include/caffe2/core/operator.h:29, from /detectron/detectron/ops/zero_even_op.h:21, from /detectron/detectron/ops/zero_even_op.cc:17: /usr/local/caffe2_build/include/caffe2/core/tensor.h:687:17: note: candidate: caffe2::TIndex caffe2::Tensor<Context>::dim(int) const [with Context = caffe2::CPUContext; caffe2::TIndex = long int] inline TIndex dim(const int i) const { ^ /usr/local/caffe2_build/include/caffe2/core/tensor.h:687:17: note: candidate expects 1 argument, 0 provided /detectron/detectron/ops/zero_even_op.cc:33:27: error: 'class caffe2::Tensorcaffe2::CPUContext' has no member named 'numel' for (auto i = 0; i < Y->numel(); i += 2) { ^ CMakeFiles/caffe2_detectron_custom_ops.dir/build.make:62: recipe for target 'CMakeFiles/caffe2_detectron_custom_ops.dir/detectron/ops/zero_even_op.cc.o' failed make[3]: Leaving directory '/detectron/build' make[3]: *** [CMakeFiles/caffe2_detectron_custom_ops.dir/detectron/ops/zero_even_op.cc.o] Error 1 make[2]: *** [CMakeFiles/caffe2_detectron_custom_ops.dir/all] Error 2 make[2]: *** Waiting for unfinished jobs.... CMakeFiles/Makefile2:67: recipe for target 'CMakeFiles/caffe2_detectron_custom_ops.dir/all' failed Scanning dependencies of target caffe2_detectron_custom_ops_gpu make[3]: Leaving directory '/detectron/build' make[3]: Entering directory '/detectron/build' [ 60%] Building CXX object CMakeFiles/caffe2_detectron_custom_ops_gpu.dir/detectron/ops/zero_even_op.cc.o In file included from /usr/local/caffe2_build/include/caffe2/core/allocator.h:22:0, from /usr/local/caffe2_build/include/caffe2/core/context.h:25, from /detectron/detectron/ops/zero_even_op.h:20, from /detectron/detectron/ops/zero_even_op.cc:17: /detectron/detectron/ops/zero_even_op.cc: In member function 'bool caffe2::ZeroEvenOp<T, Context>::RunOnDevice() [with T = float; Context = caffe2::CPUContext]': /detectron/detectron/ops/zero_even_op.cc:25:23: error: no matching function for call to 'caffe2::Tensorcaffe2::CPUContext::dim() const' CAFFE_ENFORCE(X.dim() == 1); ^ In file included from /usr/local/caffe2_build/include/caffe2/core/net.h:34:0, from /usr/local/caffe2_build/include/caffe2/core/operator.h:29, from /detectron/detectron/ops/zero_even_op.h:21, from /detectron/detectron/ops/zero_even_op.cc:17: /usr/local/caffe2_build/include/caffe2/core/tensor.h:687:17: note: candidate: caffe2::TIndex caffe2::Tensor<Context>::dim(int) const [with Context = caffe2::CPUContext; caffe2::TIndex = long int] inline TIndex dim(const int i) const { ^ /usr/local/caffe2_build/include/caffe2/core/tensor.h:687:17: note: candidate expects 1 argument, 0 provided /detectron/detectron/ops/zero_even_op.cc:33:27: error: 'class caffe2::Tensorcaffe2::CPUContext' has no member named 'numel' for (auto i = 0; i < Y->numel(); i += 2) { ^ make[3]: *** [CMakeFiles/caffe2_detectron_custom_ops_gpu.dir/detectron/ops/zero_even_op.cc.o] Error 1 CMakeFiles/caffe2_detectron_custom_ops_gpu.dir/build.make:69: recipe for target 'CMakeFiles/caffe2_detectron_custom_ops_gpu.dir/detectron/ops/zero_even_op.cc.o' failed make[3]: Leaving directory '/detectron/build' CMakeFiles/Makefile2:104: recipe for target 'CMakeFiles/caffe2_detectron_custom_ops_gpu.dir/all' failed make[2]: Leaving directory '/detectron/build' make[2]: *** [CMakeFiles/caffe2_detectron_custom_ops_gpu.dir/all] Error 2 make[1]: *** [all] Error 2 Makefile:127: recipe for target 'all' failed make[1]: Leaving directory '/detectron/build' make: *** [ops] Error 2 Makefile:13: recipe for target 'ops' failed The command '/bin/sh -c make ops' returned a non-zero code: 2

satish1901 avatar Sep 29 '19 03:09 satish1901