cpld_control_p8 frequently freezes on hera.gnu

[SamuelTrahanNOAA]

Description

When running regression tests, the cpld_control_p8 frequently freezes at this point on hera.gnu:

==> /scratch1/NCEPDEV/stmp2/Samuel.Trahan/FV3_RT/rt_21887/cpld_control_p8.err <==
150: WARNING from PE     0: Unused line in INPUT/MOM_input : ODA_INCUPD_NHOURS = 6
150:
  0: Using non-aerosol-aware version of Thompson microphysics
  0:    calling table_ccnAct routine
  0:    creating qc collision eff tables
  0:    creating rain evap table
  0:    creating ice converting to snow table
  0:    creating rain collecting graupel table
  0:    creating freezing of water drops table
  0:   ... DONE microphysical lookup tables

==> /scratch1/NCEPDEV/stmp2/Samuel.Trahan/FV3_RT/rt_21887/cpld_control_p8.out <==
  0:  in radiation_clouds_prop=           8 F           4 F F           2           1
  0:  in radiation_clouds_prop=           8 F           4 F F           2           1
  0:  in radiation_clouds_prop=           8 F           4 F F           2           1
  0:  in radiation_clouds_prop=           8 F           4 F F           2           1
  0:  in radiation_clouds_prop=           8 F           4 F F           2           1
  0:  in radiation_clouds_prop=           8 F           4 F F           2           1
  0:  in radiation_clouds_prop=           8 F           4 F F           2           1
  0:  in radiation_clouds_prop=           8 F           4 F F           2           1
  0: PASS: fcstRUN phase 1, n_atmsteps =                0 time is        12.378961
  0: UFS Aerosols: Advancing from 2021-03-22T06:00:00 to 2021-03-22T06:12:00

The gdb debugger has yielded little results because it doesn't understand the stack of the running fv3.exe process.

To Reproduce:

Run the cpld_control_p8 test a few times with hera.gnu

Additional context

Tested with hash b004ce442ac4b6428bb5cbe15345955793e19ce8