openmp offloading memory leak

[rhodrin]

When offloading to GPU via openmp a memory leak occurs. More details will follow after I've had chance to conduct further tests, but take the following example:

When running:

DEVITO_PLATFORM=nvidiaX DEVITO_ARCH=clang DEVITO_LANGUAGE=openmp OMPI_CC=clang mpirun -np 2 pytest -vv elastic_example.py

The memory usage seems to top out at a bit over 4Gb. This has been seen on setups with both clang 9 and clang 11. Both setups were using openmpi 4.0.4.

Running each of the tests included in the above example individually results in a far lower peak memory usage (~1Gb).

To do:

• MFE
• Does this occur only with MPI?
• ?

[FabioLuporini]

update: the following command is enough to reproduce:

py.test elastic_example.py -r f -vv -x

that is, no need for MPI

[FabioLuporini]

Update: these appear to be leaks inside the OMP runtime more than a devito issue

[FabioLuporini]

gone with latest clang and as of rocm5.4.2, hence closing