Trilinos
Trilinos copied to clipboard
Amesos2: HIP compile error with UMFpack enabled
Bug Report
@trilinos/amesos2 @ndellingwood @iyamazaki
Description
Reported by @mwglass.
compile error
[ 72%] Building CXX object packages/amesos2/src/CMakeFiles/amesos2.dir/Amesos2_Umfpack.cpp.o
cd /sierra/dev/mwglass/hpc/TrilinosBuild/packages/amesos2/src && /projects/cde/v2/spack/opt/spack/linux-rhel7-x86_64/gcc-7.2.0/openmpi-4.0.5-cpamfccghpjyvmctswhwfaomqs3z4maf/bin/mpic++ -I/sierra/dev/mwglass/hpc/TrilinosBuild -I/sierra/dev/mwglass/hpc/Trilinos -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/amesos2/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/KLU2/Include -I/sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/KLU2/Source -I/sierra/dev/mwglass/hpc/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/AMD/Include -I/sierra/dev/mwglass/hpc/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/COLAMD/Include -I/sierra/dev/mwglass/hpc/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/BTF/Include -I/sierra/dev/mwglass/hpc/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/UFconfig -I/sierra/dev/mwglass/hpc/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/CAMD/Include -I/sierra/dev/mwglass/hpc/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/CCOLAMD/Include -I/sierra/dev/mwglass/hpc/Trilinos/packages/common/auxiliarySoftware/SuiteSparse/src/KLU/Include -I/sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/ext -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/tpetra/core/ext -I/sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/inout -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/tpetra/core/inout -I/sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/kokkos_refactor -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/tpetra/core/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/tsqr/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/tpetra/tsqr/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/classic/LinAlg -I/sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/classic/NodeAPI -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/tpetra/classic/NodeAPI -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/tpetra/classic/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/classic/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/teuchos/kokkoscomm/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/teuchos/kokkoscomm/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/teuchos/kokkoscompat/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/teuchos/kokkoscompat/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/teuchos/parameterlist/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/teuchos/parser/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/teuchos/core/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/teuchos/core/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/kokkos/core/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/kokkos -I/sierra/dev/mwglass/hpc/proj_oneapi/code_oneapi/BAKE_ROCM/objs/tpls/spack/spack/spack_path_placeholder/spack_path_placeholder/sp/linux-rhel7-sandybridge/clang-13.0.0/boost-1.77.0-iioii23mqzh73jxhvt64ngvhwuxegl5z/include -I/sierra/dev/mwglass/hpc/Trilinos/packages/teuchos/comm/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/teuchos/remainder/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/teuchos/remainder/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/teuchos/numerics/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/kokkos-kernels/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/impl -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/kokkos-kernels/src/impl -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/impl/tpls -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/blas -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/blas/impl -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/sparse -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/sparse/impl -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/graph -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/graph/impl -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/batched -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/batched/dense -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/batched/dense/impl -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/batched/sparse -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/batched/sparse/impl -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos-kernels/src/common -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/kokkos/algorithms/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/algorithms/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/kokkos/containers/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/containers/src -I/sierra/dev/mwglass/hpc/proj_oneapi/code_oneapi/BAKE_ROCM/objs/tpls/spack/spack/spack_path_placeholder/spack_path_placeholder/sp/linux-rhel7-sandybridge/clang-13.0.0/metis-5.1.0-ojyjprthzpgoy3fnron4vruiu4lnaryn/include -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/epetra/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/epetra/src -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/epetraext/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/epetraext/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/epetraext/src/transform -I/sierra/dev/mwglass/hpc/Trilinos/packages/epetraext/src/inout -I/sierra/dev/mwglass/hpc/Trilinos/packages/epetraext/src/coloring -I/sierra/dev/mwglass/hpc/Trilinos/packages/epetraext/src/model_evaluator -I/sierra/dev/mwglass/hpc/Trilinos/packages/epetraext/src/block -I/sierra/dev/mwglass/hpc/Trilinos/packages/epetraext/src/restrict -I/sierra/dev/mwglass/hpc/TrilinosBuild/packages/triutils/src -I/sierra/dev/mwglass/hpc/Trilinos/packages/triutils/src -I/sierra/dev/mwglass/hpc/proj_oneapi/code_oneapi/BAKE_ROCM/objs/tpls/spack/spack/spack_path_placeholder/spack_path_placeholder/sp/linux-rhel7-sandybridge/clang-13.0.0/umfpack-5.1.0-r4bb27gk5jbppyewiwpnlymneicnhtz7/include -I/sierra/dev/mwglass/hpc/proj_oneapi/code_oneapi/BAKE_ROCM/objs/tpls/spack/spack/spack_path_placeholder/spack_path_placeholder/sp/linux-rhel7-sandybridge/clang-13.0.0/superlu-5.2.1-v756rlvwxioy5npr7wahhxuwaqhwvd3x/include -I/sierra/dev/mwglass/hpc/proj_oneapi/code_oneapi/BAKE_ROCM/objs/tpls/spack/spack/spack_path_placeholder/spack_path_placeholder/sp/linux-rhel7-sandybridge/clang-13.0.0/parmetis-4.0.3-kwlfgz2wkoitmb3g4rhb24pidb26wvvs/include -O2 -w --gcc-toolchain=/projects/cde/v2/spack/opt/spack/linux-rhel7-x86_64/gcc-4.8.5/gcc-7.2.0-cgjuig7mygdnho2c6pqgjagk6qfkz3w6 -fno-gpu-rdc -DNDEBUG -std=c++14 -MD -MT packages/amesos2/src/CMakeFiles/amesos2.dir/Amesos2_Umfpack.cpp.o -MF CMakeFiles/amesos2.dir/Amesos2_Umfpack.cpp.o.d -o CMakeFiles/amesos2.dir/Amesos2_Umfpack.cpp.o -c /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack.cpp
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack.cpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack_decl.hpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_SolverTraits.hpp:59:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_MatrixAdapter.hpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_MatrixAdapter_decl.hpp:55:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/Tpetra_ConfigDefs.hpp:43:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/Tpetra_Details_DefaultTypes.hpp:45:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/classic/NodeAPI/KokkosCompat_ClassicNodeAPI_Wrapper.hpp:4:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_Core.hpp:73:
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_CopyViews.hpp:307:37: error: reference to __host__ function 'operator complex' in __host__ __device__ function
a(i0) = static_cast<value_type>(b(i0));
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range<void>'
m_functor(i);
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()'
this->template exec_range<WorkTag>(iwork);
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:109:11: note: called by 'hip_parallel_launch_local_memory<Kokkos::Impl::ParallelFor<Kokkos::Impl::ViewCopy<Kokkos::View<std::complex<double> *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Experimental::HIP, Kokkos::AnonymousSpace>, Kokkos::MemoryTraits<0>>, Kokkos::View<const Kokkos::complex<double> *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Experimental::HIP, Kokkos::AnonymousSpace>, Kokkos::MemoryTraits<0>>, Kokkos::LayoutRight, Kokkos::Experimental::HIP, 1, long>, Kokkos::RangePolicy<Kokkos::Experimental::HIP, Kokkos::IndexType<long>>, Kokkos::Experimental::HIP>, 1024, 1>'
driver->operator()();
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_Complex.hpp:121:3: note: 'operator complex' declared here
operator std::complex<RealType>() const noexcept {
^
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack.cpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack_decl.hpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_SolverTraits.hpp:59:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_MatrixAdapter.hpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_MatrixAdapter_decl.hpp:55:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/Tpetra_ConfigDefs.hpp:43:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/Tpetra_Details_DefaultTypes.hpp:45:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/classic/NodeAPI/KokkosCompat_ClassicNodeAPI_Wrapper.hpp:4:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_Core.hpp:73:
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_CopyViews.hpp:307:37: error: reference to __host__ function 'operator complex' in __host__ __device__ function
a(i0) = static_cast<value_type>(b(i0));
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range<void>'
m_functor(i);
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()'
this->template exec_range<WorkTag>(iwork);
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:109:11: note: called by 'hip_parallel_launch_local_memory<Kokkos::Impl::ParallelFor<Kokkos::Impl::ViewCopy<Kokkos::View<std::complex<double> *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Experimental::HIP, Kokkos::AnonymousSpace>, Kokkos::MemoryTraits<0>>, Kokkos::View<const Kokkos::complex<double> *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Experimental::HIP, Kokkos::AnonymousSpace>, Kokkos::MemoryTraits<0>>, Kokkos::LayoutLeft, Kokkos::Experimental::HIP, 1, long>, Kokkos::RangePolicy<Kokkos::Experimental::HIP, Kokkos::IndexType<long>>, Kokkos::Experimental::HIP>, 1024, 1>'
driver->operator()();
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_Complex.hpp:121:3: note: 'operator complex' declared here
operator std::complex<RealType>() const noexcept {
^
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack.cpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack_decl.hpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_SolverTraits.hpp:59:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_MatrixAdapter.hpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_MatrixAdapter_decl.hpp:55:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/Tpetra_ConfigDefs.hpp:43:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/Tpetra_Details_DefaultTypes.hpp:45:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/classic/NodeAPI/KokkosCompat_ClassicNodeAPI_Wrapper.hpp:4:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_Core.hpp:73:
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_CopyViews.hpp:307:37: error: reference to __host__ function 'operator complex' in __host__ __device__ function
a(i0) = static_cast<value_type>(b(i0));
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range<void>'
m_functor(i);
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()'
this->template exec_range<WorkTag>(iwork);
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:109:11: note: called by 'hip_parallel_launch_local_memory<Kokkos::Impl::ParallelFor<Kokkos::Impl::ViewCopy<Kokkos::View<std::complex<double> *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Experimental::HIP, Kokkos::AnonymousSpace>, Kokkos::MemoryTraits<0>>, Kokkos::View<const Kokkos::complex<double> *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Experimental::HIP, Kokkos::AnonymousSpace>, Kokkos::MemoryTraits<0>>, Kokkos::LayoutRight, Kokkos::Experimental::HIP, 1, int>, Kokkos::RangePolicy<Kokkos::Experimental::HIP, Kokkos::IndexType<int>>, Kokkos::Experimental::HIP>, 1024, 1>'
driver->operator()();
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_Complex.hpp:121:3: note: 'operator complex' declared here
operator std::complex<RealType>() const noexcept {
^
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack.cpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_Umfpack_decl.hpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_SolverTraits.hpp:59:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_MatrixAdapter.hpp:47:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/amesos2/src/Amesos2_MatrixAdapter_decl.hpp:55:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/Tpetra_ConfigDefs.hpp:43:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/core/src/Tpetra_Details_DefaultTypes.hpp:45:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/tpetra/classic/NodeAPI/KokkosCompat_ClassicNodeAPI_Wrapper.hpp:4:
In file included from /sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_Core.hpp:73:
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_CopyViews.hpp:307:37: error: reference to __host__ function 'operator complex' in __host__ __device__ function
a(i0) = static_cast<value_type>(b(i0));
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:82:5: note: called by 'exec_range<void>'
m_functor(i);
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_Parallel_Range.hpp:104:22: note: called by 'operator()'
this->template exec_range<WorkTag>(iwork);
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/HIP/Kokkos_HIP_KernelLaunch.hpp:109:11: note: called by 'hip_parallel_launch_local_memory<Kokkos::Impl::ParallelFor<Kokkos::Impl::ViewCopy<Kokkos::View<std::complex<double> *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Experimental::HIP, Kokkos::AnonymousSpace>, Kokkos::MemoryTraits<0>>, Kokkos::View<const Kokkos::complex<double> *, Kokkos::LayoutLeft, Kokkos::Device<Kokkos::Experimental::HIP, Kokkos::AnonymousSpace>, Kokkos::MemoryTraits<0>>, Kokkos::LayoutLeft, Kokkos::Experimental::HIP, 1, int>, Kokkos::RangePolicy<Kokkos::Experimental::HIP, Kokkos::IndexType<int>>, Kokkos::Experimental::HIP>, 1024, 1>'
driver->operator()();
^
/sierra/dev/mwglass/hpc/Trilinos/packages/kokkos/core/src/Kokkos_Complex.hpp:121:3: note: 'operator complex' declared here
operator std::complex<RealType>() const noexcept {
^
4 errors generated when compiling for gfx803.
Adding @lucbv.
This issue has had no activity for 365 days and is marked for closure. It will be closed after an additional 30 days of inactivity.
If you would like to keep this issue open please add a comment and/or remove the MARKED_FOR_CLOSURE
label.
If this issue should be kept open even with no activity beyond the time limits you can add the label DO_NOT_AUTOCLOSE
.
If it is ok for this issue to be closed, feel free to go ahead and close it. Please do not add any comments or change any labels or otherwise touch this issue unless your intention is to reset the inactivity counter for an additional year.
Is this still an issue?
This issue has had no activity for 365 days and is marked for closure. It will be closed after an additional 30 days of inactivity.
If you would like to keep this issue open please add a comment and/or remove the MARKED_FOR_CLOSURE
label.
If this issue should be kept open even with no activity beyond the time limits you can add the label DO_NOT_AUTOCLOSE
.
If it is ok for this issue to be closed, feel free to go ahead and close it. Please do not add any comments or change any labels or otherwise touch this issue unless your intention is to reset the inactivity counter for an additional year.
This issue was closed due to inactivity for 395 days.