Each standard MPI function can be called with an MPI_ or PMPI_ prefix (quoting from https://www.open-mpi.org/faq/?category=perftools#PMPI), I think MPItrampoline doesn't currently support the PMPI_ calls.

While not part of the standard, MPIX_Query_cuda_support() is available in a number of MPI implementations (see https://github.com/pmodels/mpich/pull/4741). It's also being used by a number of applications (and hopefully that will grow, see my issue at https://github.com/lammps/lammps/issues/3140 which links back to the support in GROMACS). This would be a valuable inclusion in MPItrampoline since it would then be able to handle the runtime detection of CUDA support in the MPI implementation.

Currently default compilation options are set during the build of MPItrampoline, it would probably be useful to be able to fully override these, e.g.,

exec ${MPITRAMPOLINE_CC:-@CMAKE_C_COMPILER@} ${CFLAGS:-"@CMAKE_C_FLAGS@"} -I@CMAKE_INSTALL_PREFIX@/@CMAKE_INSTALL_INCLUDEDIR@ @LINK_FLAGS@ -L@CMAKE_INSTALL_PREFIX@/@CMAKE_INSTALL_LIBDIR@ -Wl,-rpath,@CMAKE_INSTALL_PREFIX@/@CMAKE_INSTALL_LIBDIR@ "$@" -lmpi -ldl

It's possible to configure a default MPI library with -DMPITRAMPOLINE_DEFAULT_LIB=XXX, it would be good to be able to also configure a default mpiexec (-DMPITRAMPOLINE_DEFAULT_MPIEXEC=XXX) so that one can have a fully functional fallback in place at build time.

Hello ! I am looking at installing MPItrampoline, and following the steps outlined in the README.md, I cannot access files later referenced.

For instance, on Summit at ORNL, using the following script:

INSTALLDIR=$HOME/mpiwrapper

module load cmake/3.18
module load gcc

cmake -S . -B build -DMPIEXEC_EXECUTABLE=mpiexec \
                               -DCMAKE_BUILD_TYPE=RelWithDebInfo \
                               -DCMAKE_INSTALL_PREFIX=$INSTALLDIR
cmake --build build
cmake --install build

The following installation is generated:

$ tree mpiwrapper/
mpiwrapper/
|-- bin
|   |-- mpicc
|   |-- mpicxx
|   |-- mpiexec
|   |-- mpifc
|   `-- mpifort
|-- include
|   |-- mpi.h
|   |-- mpi.mod
|   |-- mpi_declarations.h
|   |-- mpi_declarations_fortran.h
|   |-- mpi_declarations_fortran90.h
|   |-- mpi_defaults.h
|   |-- mpi_f08.mod
|   |-- mpi_version.h
|   |-- mpiabi.h
|   |-- mpiabif.h
|   |-- mpif.h
|   `-- mpio.h
|-- lib
|   |-- cmake
|   |   `-- MPItrampoline
|   |       |-- MPItrampolineConfig.cmake
|   |       |-- MPItrampolineConfigVersion.cmake
|   |       |-- MPItrampolineTargets-relwithdebinfo.cmake
|   |       `-- MPItrampolineTargets.cmake
|   `-- pkgconfig
|       `-- MPItrampoline.pc
`-- lib64
    |-- libmpi.a
    `-- libmpifort.a

7 directories, 24 files

The README.md dictates to use the wrapped libraries, but no shared libraries are available here. I looked through the options of the CMakeLists.txt but the only one defined in the project is the fortran flag.

Am I missing something ?

I'm trying to build the Global Arrays library with MPItrampoline and have run into some issues. This package is a dependency for Molpro and several other computational chemistry applications. Any assistance that you can provide to get it working would be greatly appreciated.

The compilation fails at https://github.com/GlobalArrays/ga/blob/f4016b869dfd1a2b2856f74a73dd9452dbbc8ae4/comex/src-mpi-pr/comex.c#L4968 with the error message:

libtool: compile:  mpicc -DHAVE_CONFIG_H -I. -I./src-common -I./src-mpi-pr -g -O2 -MT src-mpi-pr/comex.lo -MD -MP -MF src-mpi-pr/.deps/comex.Tpo -c src-mpi-pr/comex.c -o src-mpi-pr/comex.o
src-mpi-pr/comex.c: In function ‘str_mpi_retval’:
src-mpi-pr/comex.c:4932:9: error: case label does not reduce to an integer constant
         case MPI_SUCCESS       : msg = "MPI_SUCCESS"; break;
         ^

Steps to reproduce:

git clone -b develop https://github.com/GlobalArrays/ga
cd ga
./autogen.sh
./configure --with-mpi-pr --with-blas=no --with-lapack=no --with-scalapack=no --disable-f77
make

I've tried both the develop and master branches.

There are lots of configurations which can be used, we're most interested in the recommended port which uses MPI-1 with progress ranks (--with-mpi-pr) but I tried several other configurations without success.

I'm not sure whether it's an MPItrampoline issue or whether it's non-standard use of MPI within Global Arrays.

I've attached the full output from build build-ga.txt

I've tried on

• RHEL 7.9 with gcc 4.8.5
• Ubuntu 22.04 with gcc 11.3.0

I thought I would give this a full test with Fortran, and CP2K is a good benchmark for that. The build (v8.2) is failing with:

/project/60005/easybuild/build/CP2K/8.2/gmtfbf-2021a/cp2k-8.2/exts/dbcsr/src/mpi/dbcsr_mpiwrap.F:1669:21:

 1669 |       CALL mpi_bcast(msg, msglen, MPI_LOGICAL, source, gid, ierr)
      |                     1
......
 3160 |       CALL mpi_bcast(msg, msglen, ${mpi_type1}$, source, gid, ierr)
      |                     2
Error: Type mismatch between actual argument at (1) and actual argument at (2) (LOGICAL(4)/COMPLEX(4)).

Currently the default behaviour is to only build static libraries. It might be good build both static and shared libraries since then if libmpi.so is in the default search path it is not selected over the library from MPItrampoline (MPItrampoline would shadow libmpi.so and libmpi.a).