Trilinos icon indicating copy to clipboard operation
Trilinos copied to clipboard

Published 20 hours ago • verified publisher icon trilinos

Xpetra: Undefined references occur when trying to build MueLu tests/examples

Open amklinv-nnl opened this issue 4 years ago • 27 comments

Bug Report

@trilinos/xpetra @aprokop @jrood-nrel @keitat @sethrj

Description

I am trying to add some new features to spack's Trilinos package (the ability to enable Cuda, enable tests, etc) and I ran into this bug when trying to spack install --test root trilinos (meaning install the default packages of Trilinos and run the full test suite). I am using Trilinos 12.18.1, commit 55a75997332636a28afc9db1aee4ae46fe8d93e7.

[ 97%] Linking CXX executable MueLu_Driver.exe
cd /tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/muelu/test/scaling && /usr/bin/cmake -E cmake_link_script CMakeFiles/MueLu_Driver.dir/link.txt --verbose=1
/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/bin/mpic++   -DMUMPS_5_0 -std=c++11 -Wno-unused-local-typedefs -O2 -g -DNDEBUG CMakeFiles/MueLu_Driver.dir/Driver.cpp.o -o MueLu_Driver.exe  -Wl,-rpath,/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/muelu/adapters:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/muelu/src/Interface:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/muelu/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/ifpack2/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/belos/xpetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/belos/tpetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/belos/epetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/belos/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/amesos2/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/ml/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/galeri/src-xpetra:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/galeri/src-epetra:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/ifpack/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/aztecoo/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/zoltan2/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/amesos/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/common/auxiliarySoftware/SuiteSparse/src:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz/lib:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/xpetra/sup:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/xpetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/core/ext:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/core/inout:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/core/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/tsqr/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/classic/LinAlg:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/classic/NodeAPI:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/tpetra/classic/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/epetraext/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/triutils/src:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/lib:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/zoltan/src:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/lib:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/epetra/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/kokkos-kernels/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/kokkos/algorithms/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/kokkoscomm/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/kokkoscompat/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/remainder/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/numerics/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/comm/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/parameterlist/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/parser/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/teuchos/core/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/kokkos/containers/src:/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build/packages/kokkos/core/src:/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib ../../adapters/libmuelu-adapters.so.12.18.1 ../../src/Interface/libmuelu-interface.so.12.18.1 ../../src/libmuelu.so.12.18.1 ../../../../liblast_lib.a ../../../ifpack2/src/libifpack2.so.12.18.1 ../../../belos/xpetra/src/libbelosxpetra.so.12.18.1 ../../../belos/tpetra/src/libbelostpetra.so.12.18.1 ../../../belos/epetra/src/libbelosepetra.so.12.18.1 ../../../belos/src/libbelos.so.12.18.1 ../../../amesos2/src/libamesos2.so.12.18.1 ../../../ml/src/libml.so.12.18.1 ../../../galeri/src-xpetra/libgaleri-xpetra.so.12.18.1 ../../../galeri/src-epetra/libgaleri-epetra.so.12.18.1 ../../../ifpack/src/libifpack.so.12.18.1 ../../../aztecoo/src/libaztecoo.so.12.18.1 ../../../zoltan2/src/libzoltan2.so.12.18.1 ../../../amesos/src/libamesos.so.12.18.1 ../../../common/auxiliarySoftware/SuiteSparse/src/libtrilinosss.so.12.18.1 /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib/libdmumps.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib/libmumps_common.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib/libpord.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz/lib/libscalapack.so ../../../xpetra/sup/libxpetra-sup.so.12.18.1 ../../../xpetra/src/libxpetra.so.12.18.1 ../../../tpetra/core/ext/libtpetraext.so.12.18.1 ../../../tpetra/core/inout/libtpetrainout.so.12.18.1 ../../../tpetra/core/src/libtpetra.so.12.18.1 ../../../tpetra/tsqr/src/libkokkostsqr.so.12.18.1 ../../../tpetra/classic/LinAlg/libtpetraclassiclinalg.so.12.18.1 ../../../tpetra/classic/NodeAPI/libtpetraclassicnodeapi.so.12.18.1 ../../../tpetra/classic/src/libtpetraclassic.so.12.18.1 ../../../epetraext/src/libepetraext.so.12.18.1 ../../../triutils/src/libtriutils.so.12.18.1 /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libumfpack.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libamd.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libcolamd.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libcholmod.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib/libsuitesparseconfig.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/lib/libHYPRE.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib/libhdf5.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/zlib-1.2.11-qqcl66l272j2nd7kgxq47zzybm7fyl7o/lib/libz.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib/libhdf5_hl.so ../../../zoltan/src/libzoltan.so.12.18.1 /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/lib/libparmetis.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib/libmetis.so -lm ../../../epetra/src/libepetra.so.12.18.1 ../../../kokkos-kernels/src/libkokkoskernels.so.12.18.1 ../../../kokkos/algorithms/src/libkokkosalgorithms.so.12.18.1 ../../../teuchos/kokkoscomm/src/libteuchoskokkoscomm.so.12.18.1 ../../../teuchos/kokkoscompat/src/libteuchoskokkoscompat.so.12.18.1 ../../../teuchos/remainder/src/libteuchosremainder.so.12.18.1 ../../../teuchos/numerics/src/libteuchosnumerics.so.12.18.1 ../../../teuchos/comm/src/libteuchoscomm.so.12.18.1 ../../../teuchos/parameterlist/src/libteuchosparameterlist.so.12.18.1 ../../../teuchos/parser/src/libteuchosparser.so.12.18.1 ../../../teuchos/core/src/libteuchoscore.so.12.18.1 ../../../kokkos/containers/src/libkokkoscontainers.so.12.18.1 ../../../kokkos/core/src/libkokkoscore.so.12.18.1 /usr/lib/x86_64-linux-gnu/libdl.so /home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib/libopenblas.so -L/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-7.2.0/gcc-9.3.0-zscvxh4kxiomypjbg5t3asneotueayuq/lib/gcc/x86_64-pc-linux-gnu/9.3.0/../../../../lib64/ -lgfortran
CMakeFiles/MueLu_Driver.dir/Driver.cpp.o: In function `Xpetra::EpetraOperator<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >::getDomainMap() const':
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/xpetra/src/Operator/Xpetra_EpetraOperator.hpp:79: undefined reference to `Teuchos::RCP<Xpetra::Map<int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > const> const Xpetra::toXpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Epetra_BlockMap const&)'
CMakeFiles/MueLu_Driver.dir/Driver.cpp.o: In function `Xpetra::EpetraOperator<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >::getRangeMap() const':
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/xpetra/src/Operator/Xpetra_EpetraOperator.hpp:87: undefined reference to `Teuchos::RCP<Xpetra::Map<int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > const> const Xpetra::toXpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Epetra_BlockMap const&)'
CMakeFiles/MueLu_Driver.dir/Driver.cpp.o: In function `MueLu::HierarchyManager<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >::SetupHierarchy(MueLu::Hierarchy<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >&) const':
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/xpetra/src/Operator/Xpetra_EpetraOperator.hpp:79: undefined reference to `Teuchos::RCP<Xpetra::Map<int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > const> const Xpetra::toXpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Epetra_BlockMap const&)'
CMakeFiles/MueLu_Driver.dir/Driver.cpp.o: In function `void SystemSolve<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Teuchos::RCP<Xpetra::Matrix<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::RCP<Xpetra::MultiVector<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::RCP<Xpetra::MultiVector<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::RCP<MueLu::Hierarchy<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::RCP<Xpetra::Operator<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> > >&, Teuchos::basic_FancyOStream<char, std::char_traits<char> >&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, bool, bool, bool, int, int, bool, bool, int, double)':
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/muelu/test/scaling/DriverCore.hpp:274: undefined reference to `Epetra_MultiVector& Xpetra::toEpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Xpetra::MultiVector<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >&)'
/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src/packages/muelu/test/scaling/DriverCore.hpp:275: undefined reference to `Epetra_MultiVector& Xpetra::toEpetra<long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >(Xpetra::MultiVector<double, int, long, Kokkos::Compat::KokkosDeviceWrapperNode<Kokkos::Serial, Kokkos::HostSpace> >&)'
collect2: error: ld returned 1 exit status
packages/muelu/test/scaling/CMakeFiles/MueLu_Driver.dir/build.make:165: recipe for target 'packages/muelu/test/scaling/MueLu_Driver.exe' failed
make[2]: *** [packages/muelu/test/scaling/MueLu_Driver.exe] Error 1
make[2]: Leaving directory '/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build'
CMakeFiles/Makefile2:66288: recipe for target 'packages/muelu/test/scaling/CMakeFiles/MueLu_Driver.dir/all' failed
make[1]: *** [packages/muelu/test/scaling/CMakeFiles/MueLu_Driver.dir/all] Error 2
make[1]: Leaving directory '/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-build'
Makefile:184: recipe for target 'all' failed
make: *** [all] Error 2

It looks a bit like an ETI problem, but I'm not familiar enough with XPetra to fix it myself.

Steps to Reproduce

These are the flags being used by CMake within spack. Please let me know if you need more information.

==> [2020-08-06-17:44:40.010926, 20640] 'cmake' '-G' 'Unix Makefiles' 
'-DCMAKE_INSTALL_PREFIX:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw' 
'-DCMAKE_BUILD_TYPE:STRING=RelWithDebInfo' 
'-DCMAKE_VERBOSE_MAKEFILE:BOOL=ON' 
'-DCMAKE_INSTALL_RPATH_USE_LINK_PATH:BOOL=OFF' 
'-DCMAKE_INSTALL_RPATH:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/lib64;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/glm-0.9.7.1-vhlmsyf7zi6gtzj7r2lwbwtcpvrzrsgd/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hwloc-1.11.11-hlaal3qkg72qmvfi5j3rwavxy3sus5aw/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/libpciaccess-0.13.5-tzp4tftuoz3tgbozhaejlpa6papa7xyd/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/libxml2-2.9.10-pyj66asvxa5xasrsqceyofnox4kjcxfo/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/libiconv-1.16-5a5ctqi56sk3okx4sz3pubsqtiemgoeq/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/xz-5.2.5-75nr2727rsud6vwyg62acfq5c6yhvo26/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/zlib-1.2.11-qqcl66l272j2nd7kgxq47zzybm7fyl7o/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/numactl-2.0.12-symolce5bzxzzmmszxjdex22hd4xkt4y/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/matio-1.5.13-aq6h2iajtc7qtrpzvi3tqvzvadiro74u/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netcdf-c-4.7.3-jfqhyooogiyfyz6ueos3msze2keu3hhl/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib' 
'-DCMAKE_PREFIX_PATH:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/glm-0.9.7.1-vhlmsyf7zi6gtzj7r2lwbwtcpvrzrsgd;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/matio-1.5.13-aq6h2iajtc7qtrpzvi3tqvzvadiro74u;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netcdf-c-4.7.3-jfqhyooogiyfyz6ueos3msze2keu3hhl;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx' 
'-DTrilinos_VERBOSE_CONFIGURE:BOOL=OFF' 
'-DTrilinos_ENABLE_TESTS:BOOL=ON' 
'-DTrilinos_ENABLE_EXAMPLES:BOOL=OFF' 
'-DTrilinos_ENABLE_CXX11:BOOL=ON' 
'-DBUILD_SHARED_LIBS:BOOL=ON' 
'-DTrilinos_ENABLE_DEBUG:BOOL=OFF' 
'-DTPL_ENABLE_MPI:BOOL=ON' 
'-DCMAKE_C_COMPILER:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/bin/mpicc' 
'-DCMAKE_CXX_COMPILER:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/bin/mpic++' 
'-DCMAKE_Fortran_COMPILER:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62/bin/mpif90' 
'-DMPI_BASE_DIR:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openmpi-3.1.6-alw235mi5gbn7nhjyb73tbcuicmgfl62' 
'-DTPL_ENABLE_CUDA:BOOL=OFF' 
'-DTrilinos_ENABLE_ALL_OPTIONAL_PACKAGES:BOOL=OFF' 
'-DTrilinos_ENABLE_Amesos:BOOL=ON' 
'-DTrilinos_ENABLE_Amesos2:BOOL=ON' 
'-DTrilinos_ENABLE_Anasazi:BOOL=ON' 
'-DTrilinos_ENABLE_AztecOO:BOOL=ON' 
'-DTrilinos_ENABLE_Belos:BOOL=ON' 
'-DTrilinos_ENABLE_Epetra:BOOL=ON' 
'-DTrilinos_ENABLE_EpetraExt:BOOL=ON' 
'-DTrilinos_ENABLE_Ifpack:BOOL=ON' 
'-DTrilinos_ENABLE_Ifpack2:BOOL=ON' 
'-DTrilinos_ENABLE_Intrepid:BOOL=OFF' 
'-DTrilinos_ENABLE_Intrepid2:BOOL=OFF' 
'-DTrilinos_ENABLE_Isorropia:BOOL=OFF' 
'-DTrilinos_ENABLE_Kokkos:BOOL=ON' 
'-DTrilinos_ENABLE_MiniTensor:BOOL=OFF' 
'-DTrilinos_ENABLE_Mesquite:BOOL=OFF' 
'-DTrilinos_ENABLE_ML:BOOL=ON' 
'-DTrilinos_ENABLE_MueLu:BOOL=ON' 
'-DTrilinos_ENABLE_NOX:BOOL=OFF' 
'-DTrilinos_ENABLE_Piro:BOOL=OFF' 
'-DTrilinos_ENABLE_Phalanx:BOOL=OFF' 
'-DTrilinos_ENABLE_PyTrilinos:BOOL=OFF' 
'-DTrilinos_ENABLE_ROL:BOOL=OFF' 
'-DTrilinos_ENABLE_Rythmos:BOOL=OFF' 
'-DTrilinos_ENABLE_Sacado:BOOL=ON' 
'-DTrilinos_ENABLE_Shards:BOOL=OFF' 
'-DTrilinos_ENABLE_ShyLU:BOOL=OFF' 
'-DTrilinos_ENABLE_STK:BOOL=OFF' 
'-DTrilinos_ENABLE_Stratimikos:BOOL=OFF' 
'-DTrilinos_ENABLE_Teko:BOOL=OFF' 
'-DTrilinos_ENABLE_Tempus:BOOL=OFF' 
'-DTrilinos_ENABLE_Teuchos:BOOL=ON' 
'-DTrilinos_ENABLE_Tpetra:BOOL=ON' 
'-DTrilinos_ENABLE_Zoltan:BOOL=ON' 
'-DTrilinos_ENABLE_Zoltan2:BOOL=ON' 
'-DUSE_XSDK_DEFAULTS:BOOL=OFF' 
'-DTrilinos_ENABLE_SEACAS:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASExodus:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASIoss:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASEpu:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASExodiff:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASNemspread:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASNemslice:BOOL=ON' 
'-DTrilinos_ENABLE_SEACASChaco:BOOL=OFF' 
'-DTrilinos_ENABLE_SEACASNemslice:BOOL=OFF' 
'-DTPL_ENABLE_BLAS:BOOL=ON' 
'-DBLAS_LIBRARY_NAMES:STRING=openblas' 
'-DBLAS_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib' 
'-DTPL_ENABLE_LAPACK:BOOL=ON' 
'-DLAPACK_LIBRARY_NAMES:STRING=openblas' 
'-DLAPACK_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/openblas-0.3.10-alveoyre3ntnz5k2gjnzwfxdfo7e7rhl/lib' 
'-DTPL_ENABLE_GLM:BOOL=ON' 
'-DTPL_ENABLE_Matio:BOOL=ON' 
'-DTPL_ENABLE_X11:BOOL=OFF' 
'-DTrilinos_ENABLE_Gtest:BOOL=ON' 
'-DTPL_ENABLE_Netcdf:BOOL=ON' 
'-DNetCDF_ROOT:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netcdf-c-4.7.3-jfqhyooogiyfyz6ueos3msze2keu3hhl' 
'-DTPL_ENABLE_HYPRE:BOOL=ON' 
'-DHYPRE_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/include' 
'-DHYPRE_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hypre-2.18.2-udlmyypbi4vmgbm3ljjmsqko67qlqsqx/lib' 
'-DTPL_ENABLE_Boost:BOOL=OFF' 
'-DTPL_ENABLE_HDF5:BOOL=ON' 
'-DHDF5_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/include' 
'-DHDF5_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/hdf5-1.10.6-vjujbvaqs6kl2d56f3z2dayfuiw26xhk/lib' 
'-DTPL_ENABLE_Cholmod:BOOL=OFF' 
'-DTPL_ENABLE_UMFPACK:BOOL=ON' 
'-DUMFPACK_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/lib' 
'-DUMFPACK_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/suite-sparse-5.7.2-glz64ts6ri4a2nz6zwymgmhpw5afln3a/include' 
'-DUMFPACK_LIBRARY_NAMES:STRING=umfpack;amd;colamd;cholmod;suitesparseconfig' 
'-DTPL_ENABLE_METIS:BOOL=ON' 
'-DTPL_ENABLE_ParMETIS:BOOL=ON' 
'-DMETIS_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib' 
'-DMETIS_LIBRARY_NAMES:STRING=metis' 
'-DTPL_METIS_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/include' 
'-DTPL_ENABLE_ParMETIS:BOOL=ON' 
'-DParMETIS_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/lib;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/lib' 
'-DParMETIS_LIBRARY_NAMES:STRING=parmetis;metis' 
'-DTPL_ParMETIS_INCLUDE_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/parmetis-4.0.3-piwwwegnf34zdjhme7fmlyxqb5hjesiz/include;/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/metis-5.1.0-hrv3iwv3ulqnodxgmypm5dlrfmzj4zkh/include' 
'-DTPL_ENABLE_MUMPS:BOOL=ON' 
'-DTPL_ENABLE_SCALAPACK:BOOL=ON' 
'-DMUMPS_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/mumps-5.3.3-32pnjawyh6r234qqjepulz5rfwegyjoc/lib' 
'-DMUMPS_LIBRARY_NAMES:STRING=dmumps;mumps_common;pord' 
'-DSCALAPACK_LIBRARY_NAMES:STRING=scalapack' 
'-DSCALAPACK_LIBRARY_DIRS:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/netlib-scalapack-2.1.0-6oblll7nmw56jtghr4xmzrx4xkrywftz/lib' 
'-DTPL_ENABLE_SuperLUDist:BOOL=OFF' 
'-DTPL_ENABLE_SuperLU:BOOL=OFF' 
'-DTPL_ENABLE_Pnetcdf:BOOL=OFF' 
'-DTPL_ENABLE_Zlib:BOOL=OFF' 
'-DTPL_ENABLE_CGNS:BOOL=OFF' 
'-DTPL_ENABLE_ADIOS2:BOOL=OFF' 
'-DTrilinos_ENABLE_OpenMP:BOOL=OFF' 
'-DTrilinos_ENABLE_Fortran:BOOL=ON' 
'-DTrilinos_EXTRA_LINK_FLAGS:STRING=-L/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-7.2.0/gcc-9.3.0-zscvxh4kxiomypjbg5t3asneotueayuq/lib/gcc/x86_64-pc-linux-gnu/9.3.0/../../../../lib64/ -lgfortran' 
'-DTeuchos_ENABLE_COMPLEX:BOOL=OFF' 
'-DTeuchos_ENABLE_FLOAT:BOOL=OFF' 
'-DTrilinos_ENABLE_EXPLICIT_INSTANTIATION:BOOL=ON' 
'-DTpetra_INST_DOUBLE:BOOL=ON' 
'-DTpetra_INST_INT_INT:BOOL=ON' 
'-DTpetra_INST_INT_LONG:BOOL=ON' 
'-DTpetra_INST_INT_LONG_LONG:BOOL=OFF' 
'-DTpetra_INST_COMPLEX_DOUBLE:BOOL=OFF' 
'-DTpetra_INST_COMPLEX_FLOAT:BOOL=OFF' 
'-DTpetra_INST_FLOAT:BOOL=OFF' 
'-DTpetra_INST_SERIAL:BOOL=ON' 
'-DCMAKE_INSTALL_NAME_DIR:STRING=/home/klinveam/spack/opt/spack/linux-ubuntu18.04-skylake/gcc-9.3.0/trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/lib' 
'-DCMAKE_CXX_FLAGS:STRING=-DMUMPS_5_0' 
'-DTrilinos_ENABLE_Pike:BOOL=OFF' '/tmp/klinveam/spack-stage/spack-stage-trilinos-12.18.1-yrb3zjnaa5atejcehns5oiqpjopw7hjw/spack-src'

amklinv-nnl avatar Aug 10 '20 14:08 amklinv-nnl

Yuck. Literally an hour ago I also hit a trilinos/xpetra/muelu build error (https://github.com/spack/spack/pull/17971).

Can you try building trilinos with gotype=long_long? I heard a rumor that the <int, long long> instantiation will eventually be the only one supported; and so it's possible that it's the most well tested.

sethrj avatar Aug 10 '20 15:08 sethrj

-DTpetra_INST_INT_LONG:BOOL=ON might be the issue. Unless that instantiation is crucial, could you try switching it off?

cgcgcg avatar Aug 10 '20 15:08 cgcgcg

The trilinos spack recipe sets gotype=long by default, so that's why you're getting -DTpetra_INST_INT_LONG:BOOL=ON.

It also looks like you're getting Tpetra_INST_INT_INT turned on as well, which seems impossible from the spack recipe and isn't consistent with the trilinos builds that I have. Not sure what's going on there...

Anyway @amklinv-nnl , setting gotype=long_long will turn off Tpetra_INST_INT_LONG as @cgcgcg recommends and will enable Tpetra_INST_INT_LONG_LONG.

sethrj avatar Aug 10 '20 16:08 sethrj

I'll test this at the end of the day. (The machine I usually use is down, and it takes my laptop a few hours to attempt this.)

The trilinos recipe on my branch enables Tpetra_INST_INT_INT if Epetra and Xpetra are both enabled to fix this error:

  >> 979    CMake Error at packages/xpetra/CMakeLists.txt:120 (MESSAGE):
     980      If Xpetra Epetra support is enabled and Epetra 32-bit global indices are
     981      enabled, Xpetra requires that you enable Tpetra_INST_INT_INT

Assuming long_long works, I'll modify the default gotype in spack.

amklinv-nnl avatar Aug 10 '20 16:08 amklinv-nnl

Assuming long_long works, I'll modify the default gotype in spack.

@amklinv-nnl There may be challenges doing that, see spack/spack#14215.

aprokop avatar Aug 10 '20 16:08 aprokop

@trilinos/xpetra

jhux2 avatar Aug 10 '20 20:08 jhux2

long_long worked for me. My concern is that I am adding support to the spack trilinos package to build and run our test suite (https://github.com/spack/spack/pull/17900), and when I do, spack's default settings for Trilinos are going to result in the build error I saw for users that use the spack testing flags. I would hate for that to be somebody's first experience with Trilinos.

amklinv-nnl avatar Aug 11 '20 17:08 amklinv-nnl

@amklinv-nnl For any selection of variants/dependencies that causes a build/configure error, you should add a conflicts statement to the package recipe. Because Trilinos has a basically boundless list of variants and options, this list is long, but at least it'll be a way to catch the error before the project even tries to build.

sethrj avatar Aug 12 '20 11:08 sethrj

@amklinv-nnl Have you tried Trilinos develop? It seems to build fine with long..

cgcgcg avatar Aug 16 '20 20:08 cgcgcg

The trilinos spack recipe sets gotype=long by default, so that's why you're getting -DTpetra_INST_INT_LONG:BOOL=ON.

That's horrific. Who decided to enable a capability that isn't tested by default?

csiefer2 avatar Aug 18 '20 02:08 csiefer2

Is it default? I think it is related to the problem with phist package which requires trilinos variant gotype=long_long.

keitat avatar Aug 18 '20 06:08 keitat

deal.II wants gotype=int..... Need to discuss among xSDK members.

keitat avatar Aug 18 '20 06:08 keitat

Lesson: Never rely on somebody else's spack settings for software as complicated as Trilinos (or even Hypre). It won't set what you want.

csiefer2 avatar Aug 18 '20 19:08 csiefer2

We should set gotype=int as the default. Should I report to Spack issues?

keitat avatar Aug 18 '20 19:08 keitat

@keitat Don't you want gotype=long_long? I thought that Trilinos 13 was moving to hard-coding long long for global types.

sethrj avatar Aug 18 '20 19:08 sethrj

That's right, @sethrj . Then, we need to ask deal.II team to change its Trilinos requirements....

keitat avatar Aug 18 '20 19:08 keitat

Ask them "what's the deal.II with using gotype=int" 😆

sethrj avatar Aug 18 '20 19:08 sethrj

@sethrj Dunno where you heard that. Trilinos has no plans to hard-code long long for global types.

csiefer2 avatar Aug 18 '20 22:08 csiefer2

@csiefer2 What is the exact plan with version 13? I am confused....

keitat avatar Aug 18 '20 22:08 keitat

Bringing back the old issue: https://github.com/xsdk-project/xsdk-issues/issues/104 Need to double check the official decision of xSDK.

keitat avatar Aug 18 '20 22:08 keitat

@amklinv-nnl is putting a new logic in Spack. https://github.com/spack/spack/commit/0556e27e9cf573bafa9c29b77e00aa37352fdb42

keitat avatar Aug 18 '20 22:08 keitat

@jwillenbring @aprokop Apparently I misunderstood our conversation about global/local type simplification in Trilinos 13. I thought Trilinos was moving to hardcode int32_t, uint64_t for the local/global pairs and remove a huge swath of templating. Looking at the 13 release tag, that's clearly not the case for tpetra... what did I miss?

sethrj avatar Aug 19 '20 00:08 sethrj

@sethrj Please see https://github.com/trilinos/Trilinos/wiki/Trilinos_v12_code_deprecation.pdf. This explains it more clearly than I can.

jwillenbring avatar Aug 19 '20 13:08 jwillenbring

Excellent, thanks @jwillenbring ! It sounds like the change is that multiple simultaneous types will no longer be supported (this is consistent with the spack Trilinos package), and that the default instantiation should be int/long long, which is not currently the case.

sethrj avatar Aug 19 '20 13:08 sethrj

xSDK team is investigating the index data types of all library packages. I will post it once the preliminary survey is done.

keitat avatar Aug 20 '20 19:08 keitat

@keitat Did anything ever come of the index data type interview? I hit this issue recently because e4s is installed on spock with trilinos gotype=long, but some of our software requires gotype=long_long and it seems the xsdk uses gotype=int which seems counterintuitive since we have hit 2 billion unknowns even on pre-exascale systems.

sethrj avatar Jul 15 '21 16:07 sethrj

This issue has had no activity for 365 days and is marked for closure. It will be closed after an additional 30 days of inactivity. If you would like to keep this issue open please add a comment and/or remove the MARKED_FOR_CLOSURE label. If this issue should be kept open even with no activity beyond the time limits you can add the label DO_NOT_AUTOCLOSE. If it is ok for this issue to be closed, feel free to go ahead and close it. Please do not add any comments or change any labels or otherwise touch this issue unless your intention is to reset the inactivity counter for an additional year.

github-actions[bot] avatar Jul 16 '22 12:07 github-actions[bot]

This issue was closed due to inactivity for 395 days.

github-actions[bot] avatar Aug 17 '22 12:08 github-actions[bot]

Goodnight sweet prince 😢

sethrj avatar Aug 17 '22 13:08 sethrj

@sethrj do you know if these are still a thing? I do not think we had much activity on this but if this is still a thing we can have another look.

lucbv avatar Aug 17 '22 14:08 lucbv