update v3 wcprod testmods

[mahf708]

Updates wcprod testmods to align with the v3 model release.

The settings were used in the latest experiments by the coupled model team and are intended for use in the upcoming campaigns.

[BFB]

[github-actions[bot]]

PR Preview Action v1.4.7 :---: :rocket: Deployed preview to https://E3SM-Project.github.io/E3SM/pr-preview/pr-6266/ on branch gh-pages at 2024-02-29 04:23 UTC

[mahf708]

Status update --- this is blocked by the following in one of the cprnc outputs. I must confess I have no idea what it is trying to convey...

 NFIRE   (lndgrid,time)  t_index =      1     1
 WARNING: Fill patterns differ between files
 FILLDIFF NFIRE                           
                 384  (     3,     1) (     3,     1)
                 171   0.000000000000000E+00   0.000000000000000E+00
                 171   0.000000000000000E+00   0.000000000000000E+00
                 384  (     3,     1) (     3,     1)
          avg abs field values:    0.000000000000000E+00
                                   0.000000000000000E+00

[rljacob]

~~This PR will need the fix in https://github.com/E3SM-Project/E3SM/pull/6233 which should be on master tomorrow. Just rebase this branch after that.~~

That PR addresses different filldiffs but maybe it will also fix this one. @bishtgautam ?

A FILLDIFF means one or more points changed from having real values to instead having the netcdf FillValue (or vice versa).

[mahf708]

Status update: still stuck at https://github.com/E3SM-Project/E3SM/pull/6266#issuecomment-1968119907

[bishtgautam]

@mahf708 Can you please remind me which test reports the FILLDIFF for NFIRE?

[mahf708]

ERS_P4.ne4pg2_oQU480.F2010.singularity_gnu.eam-wcprod_F2010

You can find the logs here for the current runs: https://github.com/E3SM-Project/E3SM/actions/runs/8089448063?pr=6266

Or here for earlier today: https://github.com/E3SM-Project/E3SM/actions/runs/8089108765 (clicking on the this specific one with amazon-package-like box will download the logs, if you'd like to confirm)

[mahf708]

FYI: repro on chrys gnu:

FAIL ERS.ne4pg2_oQU480.F2010.chrysalis_gnu.eam-wcprod_F2010 (phase COMPARE_base_rest)
    Case dir: /lcrc/group/e3sm/ac.ngmahfouz/scratch/chrys/ERS.ne4pg2_oQU480.F2010.chrysalis_gnu.eam-wcprod_F2010.20240228_195915_gndld7
test-scheduler took 421.1206338405609 seconds

[ac.ngmahfouz@chrlogin1 ~]$ grep FILLDIFF /lcrc/group/e3sm/ac.ngmahfouz/scratch/chrys/ERS.ne4pg2_oQU480.F2010.chrysalis_gnu.eam-wcprod_F2010.20240228_195915_gndld7/run/*cprnc.out
/lcrc/group/e3sm/ac.ngmahfouz/scratch/chrys/ERS.ne4pg2_oQU480.F2010.chrysalis_gnu.eam-wcprod_F2010.20240228_195915_gndld7/run/ERS.ne4pg2_oQU480.F2010.chrysalis_gnu.eam-wcprod_F2010.20240228_195915_gndld7.elm.h0.0001-01-12-00000.nc.base.cprnc.out: FILLDIFF NFIRE      

[bishtgautam]

Thanks @mahf708. These notes should help get started on debugging this error.

[bishtgautam]

@mahf708 @rljacob The ERS.ne4pg2_oQU480.F2010.chrysalis_gnu.eam-wcprod_F2010 passes after I added a missing variable in the ELM restart file. Should I push a commit for that fix in @mahf708's branch?

[mahf708]

Feel free to do so :)

[rljacob]

merged to next.