ERROR: Unknown error in `EcosystemBalanceCheckMod.F90` with `SMS_D_Ly2_P1x1.1x1_smallvilleIA.IELMCNCROP.pm-cpu_gnu.elm-fan`

[ndkeen]

With master of Jan23 and SMS_D_Ly2_P1x1.1x1_smallvilleIA.IELMCNCROP.pm-cpu_gnu.elm-fan Also see fail with intel and DEBUG

0:  ERROR: Unknown error submitted to shr_abort_abort.
0: #0  0x234a924 in __shr_abort_mod_MOD_shr_abort_backtrace
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/share/util/shr_abort_mod.F90:104
0: #1  0x234aada in __shr_abort_mod_MOD_shr_abort_abort
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/share/util/shr_abort_mod.F90:61
0: #2  0x66f27d in __abortutils_MOD_endrun_vanilla
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/components/elm/src/main/abortutils.F90:43
0: #3  0x1553a50 in __ecosystembalancecheckmod_MOD_colpbalancecheck
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/components/elm/src/biogeochem/EcosystemBalanceCheckMod.F90:767
0: #4  0x69823e in __elm_driver_MOD_elm_drv
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/components/elm/src/main/elm_driver.F90:1335
0: #5  0x65d258 in __lnd_comp_mct_MOD_lnd_run_mct
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/components/elm/src/cpl/lnd_comp_mct.F90:617
0: #6  0x48441a in __component_mod_MOD_component_run
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/driver-mct/main/component_mod.F90:734
0: #7  0x467be1 in __cime_comp_mod_MOD_cime_run
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/driver-mct/main/cime_comp_mod.F90:2920
0: #8  0x481785 in cime_driver
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/driver-mct/main/cime_driver.F90:153
0: #9  0x4817e8 in main
0:      at /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/driver-mct/main/cime_driver.F90:23

which looks like caught error in land, where last line in land log:

 warning: FAN cannot spread manure
 column pbalance error =   -9.2743424077828759E-004           6
 Latdeg,Londeg=   40.687800000000003        267.02280000000002
 begpb       =    5.7909734729572468E-003
 endpb       =    6.7184084288024722E-003
 delta store =    9.2743495584522544E-004
 input mass  =    7.1507958115009793E-010
 output mass =    1.2643257705751606E-014
 net flux    =    7.1506693789239220E-010
 ptol_pflux: =    4.1496739374189992E-009
 sminp_to_plant: =    0.0000000000000000
 primp_to_labilep =    7.1507958115009793E-010
 supplement_to_sminp =    0.0000000000000000
 secondp_to_occlp =    1.6315555778758414E-015
 sminp_leached =    1.1011702127875765E-014
 ENDRUN:ERROR in /global/cfs/cdirs/e3sm/ndk/repos/me37-jan23/components/elm/src/biogeochem/EcosystemBalanceCheckMod.F90 at line 767                                                                                                                               \
                                                                                                                                                                                                                                                                  \

 ERROR: Unknown error submitted to shr_abort_abort.

[rljacob]

@bbye take a look at this.

[ndkeen]

Same error with master of Feb 26th

[ndkeen]

Without the elm-fan modifier, the test completed: SMS_D_Ly2_P1x1.1x1_smallvilleIA.IELMCNCROP.pm-cpu_gnu