Build error: error: identifier "cublasLtMatmulDescOpaque_t" is undefined

[anonsub29]

I am using PyTorch 1.8.1 in Cuda 10.2. whenever I try to build apex I get build error.

One of the error was "error: identifier "cublasLtMatmulDescOpaque_t" is undefined". How can I ass cublas? Build Log:

2021-04-25T17:22:28,441 Using pip 21.1 from /home/partha9/py38_apex/lib/python3.8/site-packages/pip (python 3.8)
2021-04-25T17:22:28,444 Non-user install because user site-packages disabled
2021-04-25T17:22:28,524 Created temporary directory: /tmp/pip-ephem-wheel-cache-455uizkm
2021-04-25T17:22:28,525 Created temporary directory: /tmp/pip-req-tracker-f7d4hblw
2021-04-25T17:22:28,525 Initialized build tracking at /tmp/pip-req-tracker-f7d4hblw
2021-04-25T17:22:28,525 Created build tracker: /tmp/pip-req-tracker-f7d4hblw
2021-04-25T17:22:28,525 Entered build tracker: /tmp/pip-req-tracker-f7d4hblw
2021-04-25T17:22:28,525 Created temporary directory: /tmp/pip-install-1kyf02s9
2021-04-25T17:22:28,548 Looking in links: /cvmfs/soft.computecanada.ca/custom/python/wheelhouse/nix/avx2, /cvmfs/soft.computecanada.ca/custom/python/wheelhouse/nix/generic, /cvmfs/soft.computecanada.ca/custom/python/wheelhouse/generic
2021-04-25T17:22:28,551 Processing /home/partha9/apex 2021-04-25T17:22:28,551   Created temporary directory: /tmp/pip-req-build-8zq6h56v
2021-04-25T17:22:28,551   DEPRECATION: A future pip version will change local packages to be built in-place without first copying to a temporary directory. We recommend you use --use-feature=in-tree-build to test your packages with this new behavior before it becomes the default.
2021-04-25T17:22:28,551    pip 21.3 will remove support for this functionality. You can find discussion regarding this at https://github.com/pypa/pip/issues/7555.
2021-04-25T17:22:28,990   Added file:///home/partha9/apex to build tracker '/tmp/pip-req-tracker-f7d4hblw'
2021-04-25T17:22:28,991     Running setup.py (path:/tmp/pip-req-build-8zq6h56v/setup.py) egg_info for package from file:///home/partha9/apex
2021-04-25T17:22:28,991     Created temporary directory: /tmp/pip-pip-egg-info-8ertna46
2021-04-25T17:22:28,991     Running command python setup.py egg_info
2021-04-25T17:22:30,938     No CUDA runtime is found, using CUDA_HOME='/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89'

2021-04-25T17:22:30,939     Warning: Torch did not find available GPUs on this system.
2021-04-25T17:22:30,939      If your intention is to cross-compile, this is not an error.
2021-04-25T17:22:30,939     By default, Apex will cross-compile for Pascal (compute capabilities 6.0, 6.1, 6.2),
2021-04-25T17:22:30,939     Volta (compute capability 7.0), Turing (compute capability 7.5),
2021-04-25T17:22:30,939     and, if the CUDA version is >= 11.0, Ampere (compute capability 8.0).
2021-04-25T17:22:30,939     If you wish to cross-compile for a single specific architecture,
2021-04-25T17:22:30,939     export TORCH_CUDA_ARCH_LIST="compute capability" before running setup.py.



2021-04-25T17:22:30,939     torch.__version__  = 1.8.1+cu102


2021-04-25T17:22:30,940     running egg_info
2021-04-25T17:22:30,940     creating /tmp/pip-pip-egg-info-8ertna46/apex.egg-info
2021-04-25T17:22:30,940     writing /tmp/pip-pip-egg-info-8ertna46/apex.egg-info/PKG-INFO
2021-04-25T17:22:30,940     writing dependency_links to /tmp/pip-pip-egg-info-8ertna46/apex.egg-info/dependency_links.txt
2021-04-25T17:22:30,940     writing top-level names to /tmp/pip-pip-egg-info-8ertna46/apex.egg-info/top_level.txt
2021-04-25T17:22:30,940     writing manifest file '/tmp/pip-pip-egg-info-8ertna46/apex.egg-info/SOURCES.txt'
2021-04-25T17:22:30,940     adding license file 'LICENSE' (matched pattern 'LICEN[CS]E*')
2021-04-25T17:22:30,940     reading manifest file '/tmp/pip-pip-egg-info-8ertna46/apex.egg-info/SOURCES.txt'
2021-04-25T17:22:30,941     writing manifest file '/tmp/pip-pip-egg-info-8ertna46/apex.egg-info/SOURCES.txt'
2021-04-25T17:22:30,942     /tmp/pip-req-build-8zq6h56v/setup.py:67: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
2021-04-25T17:22:30,942       warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")
2021-04-25T17:22:31,072   Source in /tmp/pip-req-build-8zq6h56v has version 0.1, which satisfies requirement apex==0.1 from file:///home/partha9/apex
2021-04-25T17:22:31,073   Removed apex==0.1 from file:///home/partha9/apex from build tracker '/tmp/pip-req-tracker-f7d4hblw'
2021-04-25T17:22:31,074 Created temporary directory: /tmp/pip-unpack-sf08mc58
2021-04-25T17:22:31,074 Skipping wheel build for apex, due to binaries being disabled for it.
2021-04-25T17:22:31,573 Installing collected packages: apex
2021-04-25T17:22:31,576   Created temporary directory: /tmp/pip-record-qf8wx_y_
2021-04-25T17:22:31,576     Running command /home/partha9/py38_apex/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-8zq6h56v/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-8zq6h56v/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-qf8wx_y_/install-record.txt --single-version-externally-managed --compile --install-headers /home/partha9/py38_apex/include/site/python3.8/apex
2021-04-25T17:22:33,327     No CUDA runtime is found, using CUDA_HOME='/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89'

2021-04-25T17:22:33,328     Warning: Torch did not find available GPUs on this system.
2021-04-25T17:22:33,328      If your intention is to cross-compile, this is not an error.
2021-04-25T17:22:33,328     By default, Apex will cross-compile for Pascal (compute capabilities 6.0, 6.1, 6.2),
2021-04-25T17:22:33,328     Volta (compute capability 7.0), Turing (compute capability 7.5),
2021-04-25T17:22:33,328     and, if the CUDA version is >= 11.0, Ampere (compute capability 8.0).
2021-04-25T17:22:33,328     If you wish to cross-compile for a single specific architecture,
2021-04-25T17:22:33,329     export TORCH_CUDA_ARCH_LIST="compute capability" before running setup.py.



2021-04-25T17:22:33,336     torch.__version__  = 1.8.1+cu102


2021-04-25T17:22:33,337     /tmp/pip-req-build-8zq6h56v/setup.py:67: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
2021-04-25T17:22:33,337       warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")

2021-04-25T17:22:33,344     Compiling cuda extensions with
2021-04-25T17:22:33,344     nvcc: NVIDIA (R) Cuda compiler driver
2021-04-25T17:22:33,344     Copyright (c) 2005-2019 NVIDIA Corporation
2021-04-25T17:22:33,344     Built on Wed_Oct_23_19:24:38_PDT_2019
2021-04-25T17:22:33,344     Cuda compilation tools, release 10.2, V10.2.89
2021-04-25T17:22:33,344     from /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin

2021-04-25T17:22:33,412     running install
2021-04-25T17:22:33,413     running build
2021-04-25T17:22:33,413     running build_ext
2021-04-25T17:22:33,444     building 'apex_C' extension
2021-04-25T17:22:33,444     creating /tmp/pip-req-build-8zq6h56v/build
2021-04-25T17:22:33,444     creating /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8
2021-04-25T17:22:33,444     creating /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc
2021-04-25T17:22:33,467     Emitting ninja build file /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/build.ninja...
2021-04-25T17:22:33,467     Compiling objects...
2021-04-25T17:22:33,467     Using envvar MAX_JOBS (2) as the number of workers...
2021-04-25T17:22:55,650     [1/1] c++ -MMD -MF /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/flatten_unflatten.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -fPIC -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/flatten_unflatten.cpp -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/flatten_unflatten.o -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=apex_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
2021-04-25T17:22:55,651     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:140:0,
2021-04-25T17:22:55,651                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
2021-04-25T17:22:55,651                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
2021-04-25T17:22:55,651                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
2021-04-25T17:22:55,651                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:13,
2021-04-25T17:22:55,651                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:22:55,651                      from /tmp/pip-req-build-8zq6h56v/csrc/flatten_unflatten.cpp:1:
2021-04-25T17:22:55,651     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:83:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
2021-04-25T17:22:55,651      #pragma omp parallel for if ((end - begin) >= grain_size)

2021-04-25T17:22:55,651     In file included from /tmp/pip-req-build-8zq6h56v/csrc/flatten_unflatten.cpp:2:0:
2021-04-25T17:22:55,651     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/utils/tensor_flatten.h: In member function ‘at::DeprecatedTypeProperties& torch::utils::TensorGroup::type()’:
2021-04-25T17:22:55,651     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/utils/tensor_flatten.h:44:28: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:22:55,651          return tensors[0].type();
2021-04-25T17:22:55,651                                 ^
2021-04-25T17:22:55,652     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:22:55,652                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:22:55,652                      from /tmp/pip-req-build-8zq6h56v/csrc/flatten_unflatten.cpp:1:
2021-04-25T17:22:55,652     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:22:55,652        DeprecatedTypeProperties & type() const {
2021-04-25T17:22:55,652                                   ^~~~
2021-04-25T17:22:55,653     creating build/lib.linux-x86_64-3.8
2021-04-25T17:22:55,653     g++ -shared -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/flatten_unflatten.o -L/home/partha9/py38_apex/lib/python3.8/site-packages/torch/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib -lc10 -ltorch -ltorch_cpu -ltorch_python -o build/lib.linux-x86_64-3.8/apex_C.cpython-38-x86_64-linux-gnu.so
2021-04-25T17:22:56,233     building 'amp_C' extension
2021-04-25T17:22:56,265     Emitting ninja build file /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/build.ninja...
2021-04-25T17:22:56,266     Compiling objects...
2021-04-25T17:22:56,266     Using envvar MAX_JOBS (2) as the number of workers...
2021-04-25T17:23:20,614     [1/11] c++ -MMD -MF /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/amp_C_frontend.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -fPIC -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/amp_C_frontend.cpp -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/amp_C_frontend.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
2021-04-25T17:23:20,615     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:140:0,
2021-04-25T17:23:20,615                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
2021-04-25T17:23:20,615                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
2021-04-25T17:23:20,615                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
2021-04-25T17:23:20,615                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:13,
2021-04-25T17:23:20,615                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:23:20,615                      from /tmp/pip-req-build-8zq6h56v/csrc/amp_C_frontend.cpp:1:
2021-04-25T17:23:20,615     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:83:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
2021-04-25T17:23:20,615      #pragma omp parallel for if ((end - begin) >= grain_size)

2021-04-25T17:23:38,331     [2/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_scale_kernel.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_scale_kernel.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_scale_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:24:01,187     [3/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_sgd_kernel.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_sgd_kernel.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_sgd_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:24:22,245     [4/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_axpby_kernel.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_axpby_kernel.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_axpby_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:24:44,653     [5/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_l2norm_kernel.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_l2norm_kernel.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_l2norm_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:25:05,723     [6/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_1.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_lamb_stage_1.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_1.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:25:26,412     [7/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_2.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_lamb_stage_2.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_2.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:25:49,576     [8/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_adam.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_adam.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_adam.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:26:09,328     [9/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_adagrad.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_adagrad.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_adagrad.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:26:35,226     [10/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_novograd.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_novograd.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:26:55,515     [11/11] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/multi_tensor_lamb.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:26:55,515     g++ -shared -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/amp_C_frontend.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_sgd_kernel.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_scale_kernel.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_axpby_kernel.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_l2norm_kernel.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_1.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb_stage_2.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_adam.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_adagrad.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_novograd.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/multi_tensor_lamb.o -L/home/partha9/py38_apex/lib/python3.8/site-packages/torch/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.8/amp_C.cpython-38-x86_64-linux-gnu.so
2021-04-25T17:26:56,151     building 'syncbn' extension
2021-04-25T17:26:56,180     Emitting ninja build file /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/build.ninja...
2021-04-25T17:26:56,180     Compiling objects...
2021-04-25T17:26:56,180     Using envvar MAX_JOBS (2) as the number of workers...
2021-04-25T17:27:24,039     [1/2] c++ -MMD -MF /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/syncbn.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -fPIC -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/syncbn.cpp -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/syncbn.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
2021-04-25T17:27:24,040     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:140:0,
2021-04-25T17:27:24,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
2021-04-25T17:27:24,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
2021-04-25T17:27:24,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
2021-04-25T17:27:24,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:13,
2021-04-25T17:27:24,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:27:24,041                      from /tmp/pip-req-build-8zq6h56v/csrc/syncbn.cpp:1:
2021-04-25T17:27:24,041     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:83:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
2021-04-25T17:27:24,041      #pragma omp parallel for if ((end - begin) >= grain_size)

2021-04-25T17:27:44,376     [2/2] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/welford.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/welford.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/welford.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:27:44,379     g++ -shared -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/syncbn.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/welford.o -L/home/partha9/py38_apex/lib/python3.8/site-packages/torch/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.8/syncbn.cpython-38-x86_64-linux-gnu.so
2021-04-25T17:27:45,002     building 'fused_layer_norm_cuda' extension
2021-04-25T17:27:45,027     Emitting ninja build file /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/build.ninja...
2021-04-25T17:27:45,027     Compiling objects...
2021-04-25T17:27:45,027     Using envvar MAX_JOBS (2) as the number of workers...
2021-04-25T17:28:09,036     [1/2] c++ -MMD -MF /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -fPIC -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
2021-04-25T17:28:09,037     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:140:0,
2021-04-25T17:28:09,037                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
2021-04-25T17:28:09,037                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
2021-04-25T17:28:09,037                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:13,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,038                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,038     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:83:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
2021-04-25T17:28:09,038      #pragma omp parallel for if ((end - begin) >= grain_size)

2021-04-25T17:28:09,038     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,038                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,039                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,039     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp: In function ‘std::vector<at::Tensor> layer_norm(at::Tensor, c10::IntArrayRef, double)’:
2021-04-25T17:28:09,039     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,039      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,039                                               ^
2021-04-25T17:28:09,039     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,039      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,039                                                                      ^~~~
2021-04-25T17:28:09,039     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,039        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,039            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,039     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,039      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,039                            ^~~~~~~~~~~
2021-04-25T17:28:09,039     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,040      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,040                             ^~~~~~~~~~
2021-04-25T17:28:09,040     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:129:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,040        CHECK_INPUT(input);
2021-04-25T17:28:09,040        ^
2021-04-25T17:28:09,040     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,040                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,040                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,040     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,040        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,041                                   ^~~~
2021-04-25T17:28:09,041     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,041                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,041                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,041     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp: In function ‘std::vector<at::Tensor> layer_norm_affine(at::Tensor, c10::IntArrayRef, at::Tensor, at::Tensor, double)’:
2021-04-25T17:28:09,041     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,041      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,042                                               ^
2021-04-25T17:28:09,042     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,042      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,042                                                                      ^~~~
2021-04-25T17:28:09,042     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,042        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,042            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,042     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,042      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,042                            ^~~~~~~~~~~
2021-04-25T17:28:09,042     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,042      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,042                             ^~~~~~~~~~
2021-04-25T17:28:09,042     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:149:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,042        CHECK_INPUT(input);
2021-04-25T17:28:09,042        ^
2021-04-25T17:28:09,042     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,043                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,043     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,043        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,043                                   ^~~~
2021-04-25T17:28:09,043     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,043                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,044                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,044                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,044     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,044      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,044                                               ^
2021-04-25T17:28:09,044     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,044      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,045                                                                      ^~~~
2021-04-25T17:28:09,045     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,045        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,045            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,045     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,045      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,045                            ^~~~~~~~~~~
2021-04-25T17:28:09,045     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,045      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,045                             ^~~~~~~~~~
2021-04-25T17:28:09,045     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:150:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,045        CHECK_INPUT(gamma);
2021-04-25T17:28:09,045        ^
2021-04-25T17:28:09,045     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,045                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,045                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,046                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,046     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,046        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,046                                   ^~~~
2021-04-25T17:28:09,046     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,046                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,047                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,047                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,047     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,047      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,047                                               ^
2021-04-25T17:28:09,047     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,047      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,047                                                                      ^~~~
2021-04-25T17:28:09,048     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,048        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,048            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,048     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,048      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,048                            ^~~~~~~~~~~
2021-04-25T17:28:09,048     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,048      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,048                             ^~~~~~~~~~
2021-04-25T17:28:09,048     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:151:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,048        CHECK_INPUT(beta);
2021-04-25T17:28:09,048        ^
2021-04-25T17:28:09,048     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,048                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,048                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,048                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,049                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,049     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,049        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,049                                   ^~~~
2021-04-25T17:28:09,049     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,049                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,050                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,050                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,050                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,050                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,050                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,050                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,050                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,050                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,050     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp: In function ‘at::Tensor layer_norm_gradient(at::Tensor, at::Tensor, at::Tensor, at::Tensor, c10::IntArrayRef, double)’:
2021-04-25T17:28:09,050     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,050      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,050                                               ^
2021-04-25T17:28:09,050     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,050      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,050                                                                      ^~~~
2021-04-25T17:28:09,050     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,051        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,051            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,051     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,051      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,051                            ^~~~~~~~~~~
2021-04-25T17:28:09,051     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,051      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,051                             ^~~~~~~~~~
2021-04-25T17:28:09,051     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:193:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,051        CHECK_INPUT(dout);
2021-04-25T17:28:09,051        ^
2021-04-25T17:28:09,051     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,051                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,051                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,051                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,052                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,052     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,052        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,052                                   ^~~~
2021-04-25T17:28:09,052     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,052                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,053                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,053                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,053                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,053                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,053                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,053                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,053                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,053                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,053     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,053      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,053                                               ^
2021-04-25T17:28:09,053     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,053      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,053                                                                      ^~~~
2021-04-25T17:28:09,053     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,053        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,054            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,054     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,054      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,054                            ^~~~~~~~~~~
2021-04-25T17:28:09,054     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,054      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,054                             ^~~~~~~~~~
2021-04-25T17:28:09,054     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:194:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,054        CHECK_INPUT(mean);
2021-04-25T17:28:09,054        ^
2021-04-25T17:28:09,054     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,054                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,054                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,054                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,054                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,054                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,055                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,055     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,055        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,055                                   ^~~~
2021-04-25T17:28:09,055     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,055                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,056                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,056                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,056                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,056                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,056                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,056     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,056      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,056                                               ^
2021-04-25T17:28:09,056     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,056      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,056                                                                      ^~~~
2021-04-25T17:28:09,056     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,056        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,056            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,056     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,057      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,057                            ^~~~~~~~~~~
2021-04-25T17:28:09,057     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,057      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,057                             ^~~~~~~~~~
2021-04-25T17:28:09,057     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:195:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,057        CHECK_INPUT(invvar);
2021-04-25T17:28:09,057        ^
2021-04-25T17:28:09,057     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,057                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,057                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,057                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,057                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,057                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,057                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,057                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,057                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,058                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,058     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,058        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,058                                   ^~~~
2021-04-25T17:28:09,058     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,058                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,059                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,059                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,059                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,059     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,059      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,059                                               ^
2021-04-25T17:28:09,059     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,059      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,059                                                                      ^~~~
2021-04-25T17:28:09,059     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,059        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,059            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,059     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,059      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,059                            ^~~~~~~~~~~
2021-04-25T17:28:09,060     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,060      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,060                             ^~~~~~~~~~
2021-04-25T17:28:09,060     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:196:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,060        CHECK_INPUT(input);
2021-04-25T17:28:09,060        ^
2021-04-25T17:28:09,060     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,060                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,061                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,061     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,061        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,061                                   ^~~~
2021-04-25T17:28:09,061     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,061                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,062                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,062                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,062     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp: In function ‘std::vector<at::Tensor> layer_norm_gradient_affine(at::Tensor, at::Tensor, at::Tensor, at::Tensor, c10::IntArrayRef, at::Tensor, at::Tensor, double)’:
2021-04-25T17:28:09,062     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,062      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,062                                               ^
2021-04-25T17:28:09,062     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,062      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,062                                                                      ^~~~
2021-04-25T17:28:09,062     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,062        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,062            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,062     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,062      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,062                            ^~~~~~~~~~~
2021-04-25T17:28:09,063     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,063      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,063                             ^~~~~~~~~~
2021-04-25T17:28:09,063     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:218:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,063        CHECK_INPUT(dout);
2021-04-25T17:28:09,063        ^
2021-04-25T17:28:09,063     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,063                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,064                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,064     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,064        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,064                                   ^~~~
2021-04-25T17:28:09,064     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,064                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,065                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,065     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,065      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,065                                               ^
2021-04-25T17:28:09,065     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,065      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,065                                                                      ^~~~
2021-04-25T17:28:09,065     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,065        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,065            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,065     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,065      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,065                            ^~~~~~~~~~~
2021-04-25T17:28:09,065     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,065      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,065                             ^~~~~~~~~~
2021-04-25T17:28:09,066     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:219:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,066        CHECK_INPUT(mean);
2021-04-25T17:28:09,066        ^
2021-04-25T17:28:09,066     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,066                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,066                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,066     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,067        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,067                                   ^~~~
2021-04-25T17:28:09,067     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,067                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,067                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,067     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,067      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,068                                               ^
2021-04-25T17:28:09,068     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,068      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,068                                                                      ^~~~
2021-04-25T17:28:09,068     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,068        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,068            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,068     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,068      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,068                            ^~~~~~~~~~~
2021-04-25T17:28:09,068     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,068      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,068                             ^~~~~~~~~~
2021-04-25T17:28:09,068     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:220:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,068        CHECK_INPUT(invvar);
2021-04-25T17:28:09,068        ^
2021-04-25T17:28:09,069     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,069                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,069                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,069     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,069        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,069                                   ^~~~
2021-04-25T17:28:09,069     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,070                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,070                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,070     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,070      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,070                                               ^
2021-04-25T17:28:09,071     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,071      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,071                                                                      ^~~~
2021-04-25T17:28:09,071     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,071        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,071            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,071     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,071      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,071                            ^~~~~~~~~~~
2021-04-25T17:28:09,071     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,071      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,071                             ^~~~~~~~~~
2021-04-25T17:28:09,071     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:221:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,071        CHECK_INPUT(input);
2021-04-25T17:28:09,071        ^
2021-04-25T17:28:09,071     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,072                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,072     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,072        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,072                                   ^~~~
2021-04-25T17:28:09,072     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,072                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,073                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,073                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,073     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,073      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,073                                               ^
2021-04-25T17:28:09,073     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,073      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,074                                                                      ^~~~
2021-04-25T17:28:09,074     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,074        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,074            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,074     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,074      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,074                            ^~~~~~~~~~~
2021-04-25T17:28:09,074     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,074      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,074                             ^~~~~~~~~~
2021-04-25T17:28:09,074     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:222:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,074        CHECK_INPUT(gamma);
2021-04-25T17:28:09,074        ^
2021-04-25T17:28:09,074     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,074                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,074                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,075                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,075     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,075        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,075                                   ^~~~
2021-04-25T17:28:09,075     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/DeviceType.h:8:0,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Device.h:3,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/core/Allocator.h:6,
2021-04-25T17:28:09,075                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:7,
2021-04-25T17:28:09,076                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,076                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,076                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,076                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,076                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,076                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,076                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,076                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,076                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,076     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:09,076      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,076                                               ^
2021-04-25T17:28:09,076     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/macros/Macros.h:173:65: note: in definition of macro ‘C10_UNLIKELY’
2021-04-25T17:28:09,076      #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
2021-04-25T17:28:09,076                                                                      ^~~~
2021-04-25T17:28:09,076     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/c10/util/Exception.h:362:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
2021-04-25T17:28:09,077        if (C10_UNLIKELY_OR_CONST(!(cond))) {                                 \
2021-04-25T17:28:09,077            ^~~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:09,077     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
2021-04-25T17:28:09,077      #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
2021-04-25T17:28:09,077                            ^~~~~~~~~~~
2021-04-25T17:28:09,077     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
2021-04-25T17:28:09,077      #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
2021-04-25T17:28:09,077                             ^~~~~~~~~~
2021-04-25T17:28:09,077     /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:223:3: note: in expansion of macro ‘CHECK_INPUT’
2021-04-25T17:28:09,077        CHECK_INPUT(beta);
2021-04-25T17:28:09,077        ^
2021-04-25T17:28:09,077     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:09,077                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:09,077                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:09,077                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:09,077                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:09,077                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:09,078                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:09,078                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:09,078                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:09,078                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:09,078                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:09,078                      from /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda.cpp:1:
2021-04-25T17:28:09,078     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:09,078        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:09,078                                   ^~~~
2021-04-25T17:28:27,112     [2/2] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda_kernel.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/layer_norm_cuda_kernel.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -maxrregcount=50 -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:28:27,112     g++ -shared -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/libffi/3.3/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/Core/gcccore/9.3.0/lib /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda.o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/layer_norm_cuda_kernel.o -L/home/partha9/py38_apex/lib/python3.8/site-packages/torch/lib -L/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/lib64 -L/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.8/fused_layer_norm_cuda.cpython-38-x86_64-linux-gnu.so
2021-04-25T17:28:27,695     building 'mlp_cuda' extension
2021-04-25T17:28:27,722     Emitting ninja build file /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/build.ninja...
2021-04-25T17:28:27,722     Compiling objects...
2021-04-25T17:28:27,722     Using envvar MAX_JOBS (2) as the number of workers...
2021-04-25T17:28:50,416     [1/2] /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/mlp_cuda.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/mlp_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=mlp_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:28:50,416     FAILED: /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/mlp_cuda.o
2021-04-25T17:28:50,416     /cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/bin/nvcc --generate-dependencies-with-compile --dependency-output /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/mlp_cuda.o.d -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/mlp_cuda.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=mlp_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++14
2021-04-25T17:28:50,416     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(194): error: identifier "cublasLtMatmulDescOpaque_t" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(195): error: identifier "cublasLtMatrixLayoutOpaque_t" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(196): error: identifier "cublasLtMatmulPreferenceOpaque_t" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(205): error: identifier "CUBLAS_COMPUTE_32F" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(205): error: identifier "cublasLtMatmulDescInit" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(234): error: identifier "cublasLtMatrixLayoutInit" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(248): error: identifier "cublasLtMatmulPreferenceInit" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(336): error: identifier "cublasLtMatmulDescOpaque_t" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(337): error: identifier "cublasLtMatrixLayoutOpaque_t" is undefined

2021-04-25T17:28:50,417     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(338): error: identifier "cublasLtMatmulPreferenceOpaque_t" is undefined

2021-04-25T17:28:50,418     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(347): error: identifier "CUBLAS_COMPUTE_32F" is undefined

2021-04-25T17:28:50,418     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(347): error: identifier "cublasLtMatmulDescInit" is undefined

2021-04-25T17:28:50,418     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(376): error: identifier "cublasLtMatrixLayoutInit" is undefined

2021-04-25T17:28:50,418     /tmp/pip-req-build-8zq6h56v/csrc/mlp_cuda.cu(390): error: identifier "cublasLtMatmulPreferenceInit" is undefined

2021-04-25T17:28:50,418     14 errors detected in the compilation of "/tmp/tmpxft_0000473e_00000000-14_mlp_cuda.compute_75.cpp1.ii".
2021-04-25T17:28:52,962     [2/2] c++ -MMD -MF /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/mlp.o.d -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -O2 -ftree-vectorize -march=core-avx2 -fno-math-errno -fPIC -fPIC -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/TH -I/home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/THC -I/cvmfs/soft.computecanada.ca/easybuild/software/2017/Core/cudacore/10.2.89/include -I/home/partha9/py38_apex/include -I/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/include/python3.8 -c -c /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp -o /tmp/pip-req-build-8zq6h56v/build/temp.linux-x86_64-3.8/csrc/mlp.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=mlp_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
2021-04-25T17:28:52,962     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Parallel.h:140:0,
2021-04-25T17:28:52,962                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/utils.h:3,
2021-04-25T17:28:52,962                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn/cloneable.h:5,
2021-04-25T17:28:52,962                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/nn.h:3,
2021-04-25T17:28:52,962                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:13,
2021-04-25T17:28:52,963                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,963                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,963     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ParallelOpenMP.h:83:0: warning: ignoring #pragma omp parallel [-Wunknown-pragmas]
2021-04-25T17:28:52,963      #pragma omp parallel for if ((end - begin) >= grain_size)

2021-04-25T17:28:52,963     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In function ‘std::vector<at::Tensor> mlp_forward(int, int, std::vector<at::Tensor>)’:
2021-04-25T17:28:52,963     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:57:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,963        for (int i = 0; i < num_layers; i++) {
2021-04-25T17:28:52,963                        ~~^~~~~~~~~~~~
2021-04-25T17:28:52,963     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:64:77: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:52,963        auto out = at::empty({batch_size, output_features.back()}, inputs[0].type());
2021-04-25T17:28:52,963                                                                                  ^
2021-04-25T17:28:52,964     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:52,964                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:52,964                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:52,964                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,964                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,965                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,965                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,965                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,965                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,965                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,965                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,965                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,965     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:52,966        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:52,966                                   ^~~~
2021-04-25T17:28:52,966     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:65:67: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:52,966        auto reserved_space = at::empty({reserved_size}, inputs[0].type());
2021-04-25T17:28:52,966                                                                        ^
2021-04-25T17:28:52,966     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:52,966                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:52,966                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:52,966                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,966                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,966                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,966                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,966                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,966                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,967                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,967                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,967                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,967     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:52,967        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:52,967                                   ^~~~
2021-04-25T17:28:52,967     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:65:68: warning: narrowing conversion of ‘reserved_size’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
2021-04-25T17:28:52,967        auto reserved_space = at::empty({reserved_size}, inputs[0].type());
2021-04-25T17:28:52,967                                                                         ^
2021-04-25T17:28:52,967     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:65:68: warning: narrowing conversion of ‘reserved_size’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
2021-04-25T17:28:52,967     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:67:59: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:52,967        auto lt_workspace = at::empty({1 << 22}, inputs[0].type());
2021-04-25T17:28:52,967                                                                ^
2021-04-25T17:28:52,967     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,968                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,968     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:52,968        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:52,968                                   ^~~~
2021-04-25T17:28:52,968     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:13:0,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,968                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,969                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,969                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,969                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,969                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,969                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,969                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,969                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,969     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In lambda function:
2021-04-25T17:28:52,969     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:69:54: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:52,969        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
2021-04-25T17:28:52,969                                                           ^
2021-04-25T17:28:52,969     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:209:28: note: in definition of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,969          const auto& the_type = TYPE;                                               \
2021-04-25T17:28:52,970                                 ^~~~
2021-04-25T17:28:52,970     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,970                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,970                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,970     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:52,970        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:52,971                                   ^~~~
2021-04-25T17:28:52,971     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:13:0,
2021-04-25T17:28:52,971                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,971                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,971                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,971                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,971                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,971                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,972                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,972                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,972                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,972     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:211:56: warning: ‘c10::ScalarType detail::scalar_type(const at::DeprecatedTypeProperties&)’ is deprecated: passing at::DeprecatedTypeProperties to an AT_DISPATCH macro is deprecated, pass an at::ScalarType instead [-Wdeprecated-declarations]
2021-04-25T17:28:52,973          at::ScalarType _st = ::detail::scalar_type(the_type);                      \
2021-04-25T17:28:52,973                                                             ^
2021-04-25T17:28:52,973     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:69:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,973        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
2021-04-25T17:28:52,973        ^
2021-04-25T17:28:52,973     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:109:23: note: declared here
2021-04-25T17:28:52,973      inline at::ScalarType scalar_type(const at::DeprecatedTypeProperties& t) {
2021-04-25T17:28:52,973                            ^~~~~~~~~~~
2021-04-25T17:28:52,973     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In lambda function:
2021-04-25T17:28:52,974     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:72:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,974          for (int i = 0; i < num_layers; i++) {
2021-04-25T17:28:52,974                          ~~^~~
2021-04-25T17:28:52,974     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,974          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,974                 ^~~~~~~~~~~
2021-04-25T17:28:52,974     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:214:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,974            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Double, double, __VA_ARGS__)  \
2021-04-25T17:28:52,974            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,974     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:69:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,974        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
2021-04-25T17:28:52,974        ^
2021-04-25T17:28:52,974     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:78:10: warning: unused variable ‘result’ [-Wunused-variable]
2021-04-25T17:28:52,974          auto result = mlp_fp<scalar_t>(
2021-04-25T17:28:52,975               ^
2021-04-25T17:28:52,975     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,975          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,975                 ^~~~~~~~~~~
2021-04-25T17:28:52,975     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:214:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,975            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Double, double, __VA_ARGS__)  \
2021-04-25T17:28:52,975            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,975     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:69:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,975        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
2021-04-25T17:28:52,975        ^
2021-04-25T17:28:52,975     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In lambda function:
2021-04-25T17:28:52,975     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:72:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,975          for (int i = 0; i < num_layers; i++) {
2021-04-25T17:28:52,975                          ~~^~~
2021-04-25T17:28:52,976     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,976          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,976                 ^~~~~~~~~~~
2021-04-25T17:28:52,976     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:215:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,976            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Float, float, __VA_ARGS__)    \
2021-04-25T17:28:52,976            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,976     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:69:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,976        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
2021-04-25T17:28:52,976        ^
2021-04-25T17:28:52,976     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:78:10: warning: unused variable ‘result’ [-Wunused-variable]
2021-04-25T17:28:52,976          auto result = mlp_fp<scalar_t>(
2021-04-25T17:28:52,976               ^
2021-04-25T17:28:52,976     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,976          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,977                 ^~~~~~~~~~~
2021-04-25T17:28:52,977     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:215:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,977            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Float, float, __VA_ARGS__)    \
2021-04-25T17:28:52,977            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,977     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:69:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,977        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
2021-04-25T17:28:52,977        ^
2021-04-25T17:28:52,977     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In lambda function:
2021-04-25T17:28:52,977     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:72:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,977          for (int i = 0; i < num_layers; i++) {
2021-04-25T17:28:52,977                          ~~^~~
2021-04-25T17:28:52,977     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,977          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,977                 ^~~~~~~~~~~
2021-04-25T17:28:52,977     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:216:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,978            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Half, at::Half, __VA_ARGS__)  \
2021-04-25T17:28:52,978            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,978     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:69:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,978        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
2021-04-25T17:28:52,978        ^
2021-04-25T17:28:52,978     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:78:10: warning: unused variable ‘result’ [-Wunused-variable]
2021-04-25T17:28:52,978          auto result = mlp_fp<scalar_t>(
2021-04-25T17:28:52,978               ^
2021-04-25T17:28:52,978     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,978          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,978                 ^~~~~~~~~~~
2021-04-25T17:28:52,978     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:216:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,978            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Half, at::Half, __VA_ARGS__)  \
2021-04-25T17:28:52,978            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,978     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:69:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,979        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_forward", [&] {
2021-04-25T17:28:52,979        ^
2021-04-25T17:28:52,979     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In function ‘std::vector<at::Tensor> mlp_backward(int, int, at::Tensor, std::vector<at::Tensor>, std::vector<at::Tensor>)’:
2021-04-25T17:28:52,979     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:115:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,979        for (int i = 0; i < num_layers; i++) {
2021-04-25T17:28:52,979                        ~~^~~~~~~~~~~~
2021-04-25T17:28:52,979     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:120:21: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,979        for (int i = 0; i < inputs.size(); i++) {
2021-04-25T17:28:52,979                        ~~^~~~~~~~~~~~~~~
2021-04-25T17:28:52,979     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:121:67: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:52,979          outputs.push_back(at::empty(inputs[i].sizes(), inputs[i].type()));  // clone for testing now
2021-04-25T17:28:52,979                                                                        ^
2021-04-25T17:28:52,979     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:52,979                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,980                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,980                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,980     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:52,980        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:52,980                                   ^~~~
2021-04-25T17:28:52,980     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:13:0,
2021-04-25T17:28:52,981                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,981                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,981                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,982                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,983                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,983                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,983                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,983                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,983                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,983     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In lambda function:
2021-04-25T17:28:52,983     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:54: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:52,983        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,983                                                           ^
2021-04-25T17:28:52,983     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:209:28: note: in definition of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,984          const auto& the_type = TYPE;                                               \
2021-04-25T17:28:52,984                                 ^~~~
2021-04-25T17:28:52,984     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,984                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,984                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,985     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:52,985        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:52,985                                   ^~~~
2021-04-25T17:28:52,985     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:13:0,
2021-04-25T17:28:52,985                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,985                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,985                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,985                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,985                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,985                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,985                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,985                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,985                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,985     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:211:56: warning: ‘c10::ScalarType detail::scalar_type(const at::DeprecatedTypeProperties&)’ is deprecated: passing at::DeprecatedTypeProperties to an AT_DISPATCH macro is deprecated, pass an at::ScalarType instead [-Wdeprecated-declarations]
2021-04-25T17:28:52,985          at::ScalarType _st = ::detail::scalar_type(the_type);                      \
2021-04-25T17:28:52,986                                                             ^
2021-04-25T17:28:52,986     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,986        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,986        ^
2021-04-25T17:28:52,986     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:109:23: note: declared here
2021-04-25T17:28:52,986      inline at::ScalarType scalar_type(const at::DeprecatedTypeProperties& t) {
2021-04-25T17:28:52,986                            ^~~~~~~~~~~
2021-04-25T17:28:52,986     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In lambda function:
2021-04-25T17:28:52,986     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:126:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,986          for (int i = 0; i < num_layers; i++) {
2021-04-25T17:28:52,986                          ~~^~~
2021-04-25T17:28:52,986     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,986          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,986                 ^~~~~~~~~~~
2021-04-25T17:28:52,986     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:214:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,987            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Double, double, __VA_ARGS__)  \
2021-04-25T17:28:52,987            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,987     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,987        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,987        ^
2021-04-25T17:28:52,987     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:130:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,987          for (int i = 0; i < inputs.size(); i++) {
2021-04-25T17:28:52,987                          ~~^~~~~~~~~~~~~~~
2021-04-25T17:28:52,987     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,987          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,987                 ^~~~~~~~~~~
2021-04-25T17:28:52,987     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:214:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,987            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Double, double, __VA_ARGS__)  \
2021-04-25T17:28:52,987            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,987     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,988        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,988        ^
2021-04-25T17:28:52,988     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:80: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:52,988          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:52,988                                                                                     ^
2021-04-25T17:28:52,988     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,988          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,988                 ^~~~~~~~~~~
2021-04-25T17:28:52,988     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:214:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,988            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Double, double, __VA_ARGS__)  \
2021-04-25T17:28:52,988            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,988     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,988        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,988        ^
2021-04-25T17:28:52,989     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,989                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,989                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,989     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:52,989        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:52,989                                   ^~~~
2021-04-25T17:28:52,990     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:13:0,
2021-04-25T17:28:52,990                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,990                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,990                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,990                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,990                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,990                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,990                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,990                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,990                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,990     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
2021-04-25T17:28:52,990          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:52,990                                       ~~~~~~~~~~^~~~~~~~~
2021-04-25T17:28:52,991     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,991          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,991                 ^~~~~~~~~~~
2021-04-25T17:28:52,991     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:214:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,991            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Double, double, __VA_ARGS__)  \
2021-04-25T17:28:52,991            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,991     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,991        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,991        ^
2021-04-25T17:28:52,991     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
2021-04-25T17:28:52,991          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:52,991                                       ~~~~~~~~~~^~~~~~~~~
2021-04-25T17:28:52,991     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,992          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,992                 ^~~~~~~~~~~
2021-04-25T17:28:52,992     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:214:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,992            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Double, double, __VA_ARGS__)  \
2021-04-25T17:28:52,992            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,992     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,992        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,992        ^
2021-04-25T17:28:52,992     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:140:10: warning: unused variable ‘result’ [-Wunused-variable]
2021-04-25T17:28:52,992          auto result = mlp_bp<scalar_t>(
2021-04-25T17:28:52,992               ^
2021-04-25T17:28:52,992     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,992          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,992                 ^~~~~~~~~~~
2021-04-25T17:28:52,992     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:214:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,992            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Double, double, __VA_ARGS__)  \
2021-04-25T17:28:52,993            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,993     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,993        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,993        ^
2021-04-25T17:28:52,993     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In lambda function:
2021-04-25T17:28:52,993     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:126:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,993          for (int i = 0; i < num_layers; i++) {
2021-04-25T17:28:52,993                          ~~^~~
2021-04-25T17:28:52,993     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,993          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,993                 ^~~~~~~~~~~
2021-04-25T17:28:52,993     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:215:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,993            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Float, float, __VA_ARGS__)    \
2021-04-25T17:28:52,993            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,993     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,994        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,994        ^
2021-04-25T17:28:52,994     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:130:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:52,994          for (int i = 0; i < inputs.size(); i++) {
2021-04-25T17:28:52,994                          ~~^~~~~~~~~~~~~~~
2021-04-25T17:28:52,994     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,994          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,994                 ^~~~~~~~~~~
2021-04-25T17:28:52,994     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:215:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,994            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Float, float, __VA_ARGS__)    \
2021-04-25T17:28:52,994            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,994     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,994        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,994        ^
2021-04-25T17:28:52,995     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:80: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:52,995          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:52,995                                                                                     ^
2021-04-25T17:28:52,995     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,995          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,995                 ^~~~~~~~~~~
2021-04-25T17:28:52,995     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:215:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,995            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Float, float, __VA_ARGS__)    \
2021-04-25T17:28:52,995            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,995     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,995        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,995        ^
2021-04-25T17:28:52,995     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:52,995                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:52,995                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,996                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,996     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:52,996        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:52,996                                   ^~~~
2021-04-25T17:28:52,996     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:13:0,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:52,996                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:52,997                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:52,997                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:52,997                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:52,997                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:52,997                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:52,997                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:52,997                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:52,997     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
2021-04-25T17:28:52,997          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:52,997                                       ~~~~~~~~~~^~~~~~~~~
2021-04-25T17:28:52,997     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,997          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,997                 ^~~~~~~~~~~
2021-04-25T17:28:52,997     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:215:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,997            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Float, float, __VA_ARGS__)    \
2021-04-25T17:28:52,998            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,998     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,998        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,998        ^
2021-04-25T17:28:52,998     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
2021-04-25T17:28:52,998          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:52,998                                       ~~~~~~~~~~^~~~~~~~~
2021-04-25T17:28:52,998     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,998          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,998                 ^~~~~~~~~~~
2021-04-25T17:28:52,998     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:215:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,998            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Float, float, __VA_ARGS__)    \
2021-04-25T17:28:52,998            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,998     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,998        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,999        ^
2021-04-25T17:28:52,999     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:140:10: warning: unused variable ‘result’ [-Wunused-variable]
2021-04-25T17:28:52,999          auto result = mlp_bp<scalar_t>(
2021-04-25T17:28:52,999               ^
2021-04-25T17:28:52,999     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:52,999          return __VA_ARGS__();                                                        \
2021-04-25T17:28:52,999                 ^~~~~~~~~~~
2021-04-25T17:28:52,999     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:215:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:52,999            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Float, float, __VA_ARGS__)    \
2021-04-25T17:28:52,999            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:52,999     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:52,999        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:52,999        ^
2021-04-25T17:28:53,000     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp: In lambda function:
2021-04-25T17:28:53,000     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:126:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:53,000          for (int i = 0; i < num_layers; i++) {
2021-04-25T17:28:53,000                          ~~^~~
2021-04-25T17:28:53,000     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:53,000          return __VA_ARGS__();                                                        \
2021-04-25T17:28:53,000                 ^~~~~~~~~~~
2021-04-25T17:28:53,000     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:216:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:53,000            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Half, at::Half, __VA_ARGS__)  \
2021-04-25T17:28:53,000            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:53,000     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:53,000        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:53,000        ^
2021-04-25T17:28:53,000     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:130:23: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
2021-04-25T17:28:53,000          for (int i = 0; i < inputs.size(); i++) {
2021-04-25T17:28:53,001                          ~~^~~~~~~~~~~~~~~
2021-04-25T17:28:53,001     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:53,001          return __VA_ARGS__();                                                        \
2021-04-25T17:28:53,001                 ^~~~~~~~~~~
2021-04-25T17:28:53,001     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:216:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:53,001            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Half, at::Half, __VA_ARGS__)  \
2021-04-25T17:28:53,001            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:53,001     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:53,001        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:53,001        ^
2021-04-25T17:28:53,001     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:80: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
2021-04-25T17:28:53,001          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:53,001                                                                                     ^
2021-04-25T17:28:53,001     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:53,002          return __VA_ARGS__();                                                        \
2021-04-25T17:28:53,002                 ^~~~~~~~~~~
2021-04-25T17:28:53,002     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:216:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:53,002            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Half, at::Half, __VA_ARGS__)  \
2021-04-25T17:28:53,002            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:53,002     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:53,002        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:53,002        ^
2021-04-25T17:28:53,002     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Tensor.h:3:0,
2021-04-25T17:28:53,002                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Context.h:4,
2021-04-25T17:28:53,002                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:9,
2021-04-25T17:28:53,002                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:53,002                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:53,002                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:53,005                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:53,005     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/core/TensorBody.h:303:30: note: declared here
2021-04-25T17:28:53,005        DeprecatedTypeProperties & type() const {
2021-04-25T17:28:53,005                                   ^~~~
2021-04-25T17:28:53,005     In file included from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/ATen.h:13:0,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
2021-04-25T17:28:53,005                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
2021-04-25T17:28:53,006                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
2021-04-25T17:28:53,006                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
2021-04-25T17:28:53,006                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/csrc/api/include/torch/all.h:8,
2021-04-25T17:28:53,006                      from /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/torch/extension.h:4,
2021-04-25T17:28:53,006                      from /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:1:
2021-04-25T17:28:53,006     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
2021-04-25T17:28:53,006          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:53,006                                       ~~~~~~~~~~^~~~~~~~~
2021-04-25T17:28:53,006     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:53,006          return __VA_ARGS__();                                                        \
2021-04-25T17:28:53,006                 ^~~~~~~~~~~
2021-04-25T17:28:53,006     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:216:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:53,006            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Half, at::Half, __VA_ARGS__)  \
2021-04-25T17:28:53,006            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:53,006     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:53,007        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:53,007        ^
2021-04-25T17:28:53,007     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:138:44: warning: narrowing conversion of ‘(work_size / sizeof (scalar_t))’ from ‘long unsigned int’ to ‘long int’ inside { } [-Wnarrowing]
2021-04-25T17:28:53,007          auto work_space = at::empty({work_size / sizeof(scalar_t)}, inputs[0].type());
2021-04-25T17:28:53,007                                       ~~~~~~~~~~^~~~~~~~~
2021-04-25T17:28:53,007     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:53,007          return __VA_ARGS__();                                                        \
2021-04-25T17:28:53,007                 ^~~~~~~~~~~
2021-04-25T17:28:53,007     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:216:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:53,007            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Half, at::Half, __VA_ARGS__)  \
2021-04-25T17:28:53,007            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:53,007     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:53,007        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:53,007        ^
2021-04-25T17:28:53,007     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:140:10: warning: unused variable ‘result’ [-Wunused-variable]
2021-04-25T17:28:53,008          auto result = mlp_bp<scalar_t>(
2021-04-25T17:28:53,008               ^
2021-04-25T17:28:53,008     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:56:12: note: in definition of macro ‘AT_PRIVATE_CASE_TYPE_USING_HINT’
2021-04-25T17:28:53,008          return __VA_ARGS__();                                                        \
2021-04-25T17:28:53,008                 ^~~~~~~~~~~
2021-04-25T17:28:53,008     /home/partha9/py38_apex/lib/python3.8/site-packages/torch/include/ATen/Dispatch.h:216:7: note: in expansion of macro ‘AT_PRIVATE_CASE_TYPE’
2021-04-25T17:28:53,008            AT_PRIVATE_CASE_TYPE(NAME, at::ScalarType::Half, at::Half, __VA_ARGS__)  \
2021-04-25T17:28:53,008            ^~~~~~~~~~~~~~~~~~~~
2021-04-25T17:28:53,008     /tmp/pip-req-build-8zq6h56v/csrc/mlp.cpp:124:3: note: in expansion of macro ‘AT_DISPATCH_FLOATING_TYPES_AND_HALF’
2021-04-25T17:28:53,008        AT_DISPATCH_FLOATING_TYPES_AND_HALF(inputs[0].type(), "mlp_backward", [&] {
2021-04-25T17:28:53,008        ^
2021-04-25T17:28:53,008     ninja: build stopped: subcommand failed.
2021-04-25T17:28:53,009     Traceback (most recent call last):
2021-04-25T17:28:53,009       File "/home/partha9/py38_apex/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 1667, in _run_ninja_build
2021-04-25T17:28:53,009         subprocess.run(
2021-04-25T17:28:53,009       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/subprocess.py", line 512, in run
2021-04-25T17:28:53,009         raise CalledProcessError(retcode, process.args,
2021-04-25T17:28:53,009     subprocess.CalledProcessError: Command '['ninja', '-v', '-j', '2']' returned non-zero exit status 1.

2021-04-25T17:28:53,009     The above exception was the direct cause of the following exception:

2021-04-25T17:28:53,009     Traceback (most recent call last):
2021-04-25T17:28:53,009       File "<string>", line 1, in <module>
2021-04-25T17:28:53,009       File "/tmp/pip-req-build-8zq6h56v/setup.py", line 540, in <module>
2021-04-25T17:28:53,009         setup(
2021-04-25T17:28:53,009       File "/home/partha9/py38_apex/lib/python3.8/site-packages/setuptools/__init__.py", line 153, in setup
2021-04-25T17:28:53,010         return distutils.core.setup(**attrs)
2021-04-25T17:28:53,010       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/core.py", line 148, in setup
2021-04-25T17:28:53,010         dist.run_commands()
2021-04-25T17:28:53,010       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/dist.py", line 966, in run_commands
2021-04-25T17:28:53,010         self.run_command(cmd)
2021-04-25T17:28:53,010       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/dist.py", line 985, in run_command
2021-04-25T17:28:53,010         cmd_obj.run()
2021-04-25T17:28:53,010       File "/home/partha9/py38_apex/lib/python3.8/site-packages/setuptools/command/install.py", line 61, in run
2021-04-25T17:28:53,010         return orig.install.run(self)
2021-04-25T17:28:53,010       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/command/install.py", line 545, in run
2021-04-25T17:28:53,010         self.run_command('build')
2021-04-25T17:28:53,010       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/cmd.py", line 313, in run_command
2021-04-25T17:28:53,010         self.distribution.run_command(command)
2021-04-25T17:28:53,010       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/dist.py", line 985, in run_command
2021-04-25T17:28:53,011         cmd_obj.run()
2021-04-25T17:28:53,011       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/command/build.py", line 135, in run
2021-04-25T17:28:53,011         self.run_command(cmd_name)
2021-04-25T17:28:53,011       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/cmd.py", line 313, in run_command
2021-04-25T17:28:53,011         self.distribution.run_command(command)
2021-04-25T17:28:53,011       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/dist.py", line 985, in run_command
2021-04-25T17:28:53,011         cmd_obj.run()
2021-04-25T17:28:53,011       File "/home/partha9/py38_apex/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 79, in run
2021-04-25T17:28:53,011         _build_ext.run(self)
2021-04-25T17:28:53,011       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/command/build_ext.py", line 340, in run
2021-04-25T17:28:53,012         self.build_extensions()
2021-04-25T17:28:53,012       File "/home/partha9/py38_apex/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 708, in build_extensions
2021-04-25T17:28:53,013         build_ext.build_extensions(self)
2021-04-25T17:28:53,013       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/command/build_ext.py", line 449, in build_extensions
2021-04-25T17:28:53,013         self._build_extensions_serial()
2021-04-25T17:28:53,013       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/command/build_ext.py", line 474, in _build_extensions_serial
2021-04-25T17:28:53,013         self.build_extension(ext)
2021-04-25T17:28:53,013       File "/home/partha9/py38_apex/lib/python3.8/site-packages/setuptools/command/build_ext.py", line 196, in build_extension
2021-04-25T17:28:53,013         _build_ext.build_extension(self, ext)
2021-04-25T17:28:53,013       File "/cvmfs/soft.computecanada.ca/easybuild/software/2020/avx2/Core/python/3.8.2/lib/python3.8/distutils/command/build_ext.py", line 528, in build_extension
2021-04-25T17:28:53,013         objects = self.compiler.compile(sources,
2021-04-25T17:28:53,014       File "/home/partha9/py38_apex/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 529, in unix_wrap_ninja_compile
2021-04-25T17:28:53,014         _write_ninja_file_and_compile_objects(
2021-04-25T17:28:53,014       File "/home/partha9/py38_apex/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 1354, in _write_ninja_file_and_compile_objects
2021-04-25T17:28:53,014         _run_ninja_build(
2021-04-25T17:28:53,014       File "/home/partha9/py38_apex/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 1683, in _run_ninja_build
2021-04-25T17:28:53,014         raise RuntimeError(message) from e
2021-04-25T17:28:53,014     RuntimeError: Error compiling objects for extension
2021-04-25T17:28:53,117 ERROR: Command errored out with exit status 1: /home/partha9/py38_apex/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-8zq6h56v/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-8zq6h56v/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-qf8wx_y_/install-record.txt --single-version-externally-managed --compile --install-headers /home/partha9/py38_apex/include/site/python3.8/apex Check the logs for full command output.
2021-04-25T17:28:53,118 Exception information:
2021-04-25T17:28:53,118 Traceback (most recent call last):
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/req/req_install.py", line 806, in install
2021-04-25T17:28:53,118     success = install_legacy(
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/operations/install/legacy.py", line 81, in install
2021-04-25T17:28:53,118     raise LegacyInstallFailure
2021-04-25T17:28:53,118 pip._internal.operations.install.legacy.LegacyInstallFailure
2021-04-25T17:28:53,118 
2021-04-25T17:28:53,118 During handling of the above exception, another exception occurred:
2021-04-25T17:28:53,118 
2021-04-25T17:28:53,118 Traceback (most recent call last):
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/cli/base_command.py", line 180, in _main
2021-04-25T17:28:53,118     status = self.run(options, args)
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/cli/req_command.py", line 204, in wrapper
2021-04-25T17:28:53,118     return func(self, options, args)
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/commands/install.py", line 393, in run
2021-04-25T17:28:53,118     installed = install_given_reqs(
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/req/__init__.py", line 77, in install_given_reqs
2021-04-25T17:28:53,118     requirement.install(
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/req/req_install.py", line 824, in install
2021-04-25T17:28:53,118     six.reraise(*exc.parent)
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_vendor/six.py", line 703, in reraise
2021-04-25T17:28:53,118     raise value
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/operations/install/legacy.py", line 69, in install
2021-04-25T17:28:53,118     runner(
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/utils/subprocess.py", line 274, in runner
2021-04-25T17:28:53,118     call_subprocess(
2021-04-25T17:28:53,118   File "/home/partha9/py38_apex/lib/python3.8/site-packages/pip/_internal/utils/subprocess.py", line 244, in call_subprocess
2021-04-25T17:28:53,118     raise InstallationSubprocessError(proc.returncode, command_desc)
2021-04-25T17:28:53,118 pip._internal.exceptions.InstallationSubprocessError: Command errored out with exit status 1: /home/partha9/py38_apex/bin/python3 -u -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-8zq6h56v/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-8zq6h56v/setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', open)(__file__) if os.path.exists(__file__) else io.StringIO('"'"'from setuptools import setup; setup()'"'"');code = f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-qf8wx_y_/install-record.txt --single-version-externally-managed --compile --install-headers /home/partha9/py38_apex/include/site/python3.8/apex Check the logs for full command output.
2021-04-25T17:28:53,128 Removed build tracker: '/tmp/pip-req-tracker-f7d4hblw'

[Annbless]

I tried the command git reset --hard a651e2c24ecf97cbf367fd3f330df36760e1c597 to revert the repo to several days ago and this works for me.

[Ema1997]

I tried the command git reset --hard a651e2c24ecf97cbf367fd3f330df36760e1c597 to revert the repo to several days ago and this works for me.

Thanks a lot, this command solved my problem too.

[troeshust]

similar issue with cuda 10.2 and torch 1.7.0. https://github.com/NVIDIA/apex/issues/1091#issuecomment-826578213 solved the problem

[quentin-wang]

Thanks very much, #1091 (comment) solved the problem CUDA 10.1, torch 1.7.1

[lilong-wen]

Thanks a lot, this solved my problem too.

[Hislocked]

CUDA 10.2, torch 1.8.0 works too. THX

[seryilmaz]

It should be fixed in master now with https://github.com/NVIDIA/apex/pull/1108.

[jimmy19991222]

I tried the command git reset --hard a651e2c24ecf97cbf367fd3f330df36760e1c597 to revert the repo to several days ago and this works for me.

thanks, solve my problem too!