Valentin Churavy
Valentin Churavy
@peterahrens wrote some benchmarks a couple of years ago. Pete do you still have those around?
Here is the latency from OSU https://github.com/JuliaParallel/UCX.jl/blob/main/examples/benchmarks/mpi/latency.jl
> should we just make it the abi key? I don't think we can we use that for Platform support. I am not sure if MPIPreferences is the right place....
My reasoning is that the information in MPIPreferences.jl is used by other packages (that's why we separated it), but which mpiconst file to load is really only relevant to MPI.jl
I like `use_custom_abi_file` and `use_default_abi_file` for symmetry, but I have no strong feeling.
You are using `srun -n1` to launch Julia. What happens when you do `salloc -n5` and set `export JULIA_MPI_TEST_NPROCS=4`? Do I understand correctly that your `mpiexec` defaults to using `srun`...
What happens if you only use `salloc`, but not `srun`? My issue is that you are starting a slurm task and within that task then run MPI. nested srun commands...
Can you try writing a C reproducer? I am not sure this is a Julia issue. What happens if you run this under `mpirun`/`mpiexec`?
> ModuleCmd_Load.c(213):ERROR:105: Unable to locate a modulefile for 'julia/1.6'
I just registered KernelAbstractions 0.6, but I would hold off on moving to that. KernelAbstraction 0.5.X should work well on Julia 1.6