fatal error: cublas_v2.h: No such file or directory

[shizhediao]

gcc -pthread -B /home/sdiaoaa/.conda/envs/domains/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/sdiaoaa/.conda/ envs/domains/lib/python3.7/site-packages/torch/include -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/sdiaoaa/.conda/e nvs/domains/lib/python3.7/site-packages/torch/include/TH -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include/THC -I/home/sdiaoaa/.conda/envs/domains/inclu de/python3.7m -c csrc/flatten_unflatten.cpp -o build/temp.linux-x86_64-3.7/csrc/flatten_unflatten.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=apex_C -D_GLIBCXX_USE_CXX 11_ABI=1 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++

g++ -pthread -shared -B /home/sdiaoaa/.conda/envs/domains/compiler_compat -L/home/sdiaoaa/.conda/envs/domains/lib -Wl,-rpath=/home/sdiaoaa/.conda/envs/domains/lib -Wl,--no-as-n

eeded -Wl,--sysroot=/ build/temp.linux-x86_64-3.7/csrc/flatten_unflatten.o -o build/lib.linux-x86_64-3.7/apex_C.cpython-37m-x86_64-linux-gnu.so
building 'amp_C' extension
gcc -pthread -B /home/sdiaoaa/.conda/envs/domains/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/sdiaoaa/.conda/ envs/domains/lib/python3.7/site-packages/torch/include -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include/torch/csrc/api/include -I/home/sdiaoaa/.conda/e nvs/domains/lib/python3.7/site-packages/torch/include/TH -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/sdiaoaa /.conda/envs/domains/include/python3.7m -c csrc/amp_C_frontend.cpp -o build/temp.linux-x86_64-3.7/csrc/amp_C_frontend.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EX TENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=1 -std=c++11
cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
/usr/local/cuda/bin/nvcc -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/inc lude/torch/csrc/api/include -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include/TH -I/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/i nclude/THC -I/usr/local/cuda/include -I/home/sdiaoaa/.conda/envs/domains/include/python3.7m -c csrc/multi_tensor_sgd_kernel.cu -o build/temp.linux-x86_64-3.7/csrc/multi_tensor_sgd_ kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=1 -gencode=arch=compute_75,code=sm_75 -std=c++11
In file included from csrc/multi_tensor_sgd_kernel.cu:3:0:
/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/torch/include/ATen/cuda/CUDAContext.h:7:10: fatal error: cublas_v2.h: No such file or directory
#include <cublas_v2.h>
^~~~~~~~~~~~~
compilation terminated.
error: command '/usr/local/cuda/bin/nvcc' failed with exit status 1
Running setup.py install for apex ... error
Rolling back uninstall of apex
Moving to /import/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/apex-0.1.dist-info/
from /import/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/~pex-0.1.dist-info
Moving to /import/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/apex/
from /import/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/~pex
Replacing /import/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/apex-0.1.dist-info/ from /import/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/~pex- 0.1.dist-info
Replacing /import/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/apex/ from /import/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/~pex
ERROR: Command errored out with exit status 1: /home/sdiaoaa/.conda/envs/domains/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-czw64o_v/ setup.py'"'"'; file='"'"'/tmp/pip-req-build-czw64o_v/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.clo se();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-4ei2jksn/install-record.txt --single-version-externally-managed --compile --install-headers /home/sdiaoaa/.conda/envs/domains/include/python3.7m/apex Check the logs for full command output.
Exception information:
Traceback (most recent call last):
File "/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 851, in install
req_description=str(self.req),
File "/home/sdiaoaa/.conda/envs/domains/lib/python3.7/site-packages/pip/_internal/operations/install/legacy.py", line 86, in install
raise LegacyInstallFailure
pip._internal.operations.install.legacy.LegacyInstallFailure