global-workflow icon indicating copy to clipboard operation
global-workflow copied to clipboard

Explicitly disable hyper-threading on Hera, Hercules, and Orion

Open DavidHuber-NOAA opened this issue 1 year ago • 2 comments

What new functionality do you need?

Hera, Hercules, and Orion (and possibly Jet) enable hyper-threading by default. This should be disabled explicitly by adding the sbatch/srun flag --hint=nomultithread.

What are the requirements for the new functionality?

All jobs should run threaded tasks across cores, not within a single core's threads.

Acceptance Criteria

Identical results without significant differences in run times.

Suggest a solution (optional)

Add --hint=nomultithread to each .env file.

DavidHuber-NOAA avatar Aug 27 '24 12:08 DavidHuber-NOAA

Just curious, Will we run into any problems if we don't disable hyper-threading?

guoqing-noaa avatar Sep 30 '24 18:09 guoqing-noaa

@guoqing-noaa Probably not. There is only one case that I have been made aware of, but it does not affect the global application. Regional apps (RRFS/HAFS) that read/write netCDF files in parallel within the GSI often experience errors while attempting to read and write from the same file when hyperthreading is enabled. More details are available in https://github.com/NOAA-EMC/GSI/issues/694.

DavidHuber-NOAA avatar Sep 30 '24 20:09 DavidHuber-NOAA