Valentin Churavy

Yeah Simon mentioned that he had trouble with MPICH https://github.com/JuliaParallel/MPI.jl/issues/360#issuecomment-597426035 > How would I be able to achieve this? I don't have a ready made solution, but as an example:...

It would be good to have this be configurable, I have to think a bit more about this, but MPI implementation are free to not be threadsafe (or use libraries...

Yeah we need to synchronize the CUDA stream on which the async memcpy HtoD is launched. So I think the right thing to do is to `CUDA.synchronize(CuStreamPerThread())` before MPI ops....

Just as a quick update the right thing to do now is `CUDA.synchronize()` or to be explicit `CUDA.synchronize(CUDA.stream())`

You **must** listen MPIPreferences in the `[extras]` section of you Project.toml > You can copy LocalPreferences.toml to a different project folder, but you must list MPIPreferences in the [extras] section...

Ah I see I missed that you did indeed ran the command in your Project. Will investigate

``` ~/builds/julia-1.7.2/bin/julia --project=repr (repr) pkg> add MPI#master ... [da04e1cc] ~ MPI v0.19.2 ⇒ v0.20.0-dev `https://github.com/JuliaParallel/MPI.jl.git#master` [3da0fdf6] + MPIPreferences v0.1.1 ... julia> using MPI julia> MPI.use_system_binary() ┌ Info: MPI implementation │...

oO @staticfloat is this intended: ``` ➜ ~ ls mpiprefs LocalPreferences.toml Project.toml ➜ ~ ls repr Manifest.toml Project.toml cat mpiprefs/LocalPreferences.toml [MPIPreferences] abi = "OpenMPI" binary = "system" libmpi = "libmpi"...

The issue of course is: https://github.com/JuliaPackaging/Preferences.jl/blob/80b550904ae5b5615ec4168a2135f87c397a92b8/src/Preferences.jl#L198 ``` MPIPreferences = Base.UUID("3da0fdf6-3ccc-4f1b-acd9-58baa6c99267") julia> Preferences.find_first_project_with_uuid(MPIPreferences) ("/home/vchuravy/mpiprefs/Project.toml", "MPIPreferences") shell> cat mpiprefs/Project.toml [extras] MPIPreferences = "3da0fdf6-3ccc-4f1b-acd9-58baa6c99267" ```

What version of Julia are you using?