Jian Sun

Hi @brian-eaton , thank you very much for tracking down this issue and providing so many helpful details. On Derecho, once we load the `parallelio/2.6.2` module, the `PIO_VERSION_MAJOR` environment variable...

Thanks @fischer-ncar for your information. That is good to know. By comparing the changes between `cam6_3_153` and `cam6_3_154`, I see: - cmeps is updated from tag `0.14.49` to `0.14.59`. -...

Hi @fischer-ncar , thanks for your quick reply. I used `cime6.0.217_httpsbranch02` tag in `cam6_3_153` and `cam6_3_154`. I switched to `cime6.0.238_httpsbranch01` in `cam6_3_154` and still got the same error (/glade/derecho/scratch/sunjian/cam6_run/F2000dev.ne30pg3_ne30pg3_mg17.derecho.nvhpc.gpu04_pcols00016_mpi0128_thread001_rrtmg.aer_bug_154_v2/bld/cesm.bldlog.240508-145200). However,...

Hi @brian-eaton and @fischer-ncar , it turns out that by switching to the latest `ccs_config_cesm0.0.106` tag, I was able to build the same case with the `cam6_3_154` tag on Derecho....

@brian-eaton I think I find the reason about the failure of `cam6_3_154`: - In `cam6_3_154`, the `PIO_LIBDIR` is explicitly defined in `CMEPS` (https://github.com/ESCOMP/CMEPS/blob/d6dc5710f7ec82315256364bdb6febef565ea507/cime_config/buildexe#L114-L116). Therefore, the section you pointed out at...

Thanks @brian-eaton . That sounds great!

Thanks @PeterHjortLauritzen for working on this. Would it be appropriate to clean up the OpenMP directives together in this issue since threading is not supported for the SE dycore based...

It turns out that the SCM test only uses one MPI task. In the `ccs_config0.0.85`, it used the raw `mpiexec` command (https://github.com/ESMCI/ccs_config_cesm/blob/ccs_config_cesm0.0.85/machines/config_machines.xml#L1283-L1288) and it worked fine with `-n 1` option....

@jedwards4b found out that there was an issue between ESMF and `mpibind` when only using a single MPI task.

Thanks Brian for opening this issue. To provide additional information: - The failure of running RRTMGP GPU code in CAM is caused by this change (https://github.com/ESCOMP/CAM/blob/cam6_3_148/src/physics/rrtmgp/radiation.F90#L964). In particular, the problem...