WRFDA PLUS V4.6.0 fails with intel llvm compilers.

[HathewayWill]

@islas @mgduda

Describe the bug During the installation of WRFPLUS v4.6.0 a massive memory usage occurs that happens only with the intel llvm compilers and not with GNU.

I have attached relevant log files.

configure.log configure.wrf.txt

wrfplus1.compile.log

To Reproduce

cd "${WRF_FOLDER}"/Downloads
	mkdir "${WRF_FOLDER}"/WRFPLUS
	tar -xvzf WRF-${WRF_VERSION}.tar.gz -C "${WRF_FOLDER}"/WRFPLUS

	# If statment for changing folder name
	if [ -d ""${WRF_FOLDER}"/WRFPLUS/WRF" ]; then
		mv -f "${WRF_FOLDER}"/WRFPLUS/WRF "${WRF_FOLDER}"/WRFPLUS/WRFV${WRF_VERSION}
	fi

	cd "${WRF_FOLDER}"/WRFPLUS/WRFV${WRF_VERSION}
	mv * "${WRF_FOLDER}"/WRFPLUS
	cd "${WRF_FOLDER}"/WRFPLUS
	rm -rf WRFV${WRF_VERSION}/
	export NETCDF=$DIR/NETCDF
	export HDF5=$DIR/grib2
	export LD_LIBRARY_PATH=$DIR/grib2/lib:$LD_LIBRARY_PATH
	./clean -a

	if [ ${auto_config} -eq 1 ]; then
		echo 40 | ./configure wrfplus 2>&1 | tee configure.log #Option 40 for intel and distribunted memory
	else
		./configure wrfplus 2>&1 | tee configure.log #Option 40 for intel and distribunted memory
	fi
	echo " "

	sed -i '136s|mpif90 -f90=$(SFC)|mpiifx|g' "${WRF_FOLDER}"/WRFPLUS/configure.wrf
	sed -i '137s|mpicc -cc=$(SCC)|mpiicx|g' "${WRF_FOLDER}"/WRFPLUS/configure.wrf


	./compile -j $CPU_HALF_EVEN wrfplus 2>&1 | tee wrfplus1.compile.log

Expected behavior No Memory leak

Screenshots

[islas]

I'd caution to label this as a "memory leak" as that has technical implications of the underlying root cause. It is a memory usage issue with large files when compiling with the new oneAPI compilers, however.

Consider compiling with a very limited number of threads (some files require upwards of 25GB individually) until a future fix is implemented.

[HathewayWill]

@islas

I will change the title of the issue to reflect that.

[HathewayWill]

I'd caution to label this as a "memory leak" as that has technical implications of the underlying root cause. It is a memory usage issue with large files when compiling with the new oneAPI compilers, however.

Consider compiling with a very limited number of threads (some files require upwards of 25GB individually) until a future fix is implemented.

I have tried with 4 threads and it still faults the machine. Should I attempt with 1 or 2 threads to help you with this issue @islas ?

[islas]

Definitely try just one thread. It will be much slower but it should compile at the very least.

[HathewayWill]

@islas

Definitely try just one thread. It will be much slower but it should compile at the very least.

Tried one thread and it worked, opened 4 posts on the wrf forum about this and my tests. I'll leave it to you to let me know if you need me to do more testing or create pull requests.

Here are the links:

https://forum.mmm.ucar.edu/threads/wrf-chem-w-kpp-wrf-chemda-v4-6-0-intel-llvm-compilers.17266/

https://forum.mmm.ucar.edu/threads/wrf-arw-v4-6-0-intel-llvm-compilers.17265/

https://forum.mmm.ucar.edu/threads/wrf-4dvar-v4-6-0-intel-llvm-compilers.17264/

https://forum.mmm.ucar.edu/threads/wrf-plus-4dvar-v4-6-0-intel-llvm-compilers.17263/

[HathewayWill]

Closing issue and opening again with new information