E3SM icon indicating copy to clipboard operation
E3SM copied to clipboard

Add FATES land use change module to pass LUH2 data to FATES

Open glemieux opened this issue 1 year ago • 20 comments

This pull request adds a new module, the structure of which is adopted from the dyn_subgrid code, to enable e3sm to ingest minimally processed luh2 data to be passed to FATES. A new namelist variable is introduced use_fates_luh, to engage the module functionality, which is off by default. The luh2 dataset to be ingested is a minimally processed concatenation of the luh2 state, transition and management datasets.

These changes also include a minor bug fix discovered in the process of developing the code, in which if the number of FATES patches being defined by the user in the fates parameter file is greater than the max_patch_per_col elm variable, would result in a BalanceCheck error.

To be coordinated with https://github.com/NGEET/fates/pull/1040

[nonBFB] for FATES

glemieux avatar Jun 13 '23 16:06 glemieux

@glemieux Can we add a new test for this PR?

bishtgautam avatar Jun 27 '23 19:06 bishtgautam

Status update: there is a forthcoming update to the fates luh2 data pipeline https://github.com/NGEET/fates/pull/1032 that will result in an update to the default fates landuse data set. As such I've added "WIP" to this PR.

glemieux avatar Jun 27 '23 19:06 glemieux

status: probably another month waiting on FATES refactor.

rljacob avatar Jul 06 '23 17:07 rljacob

Need #5849 and also still WIP.

rljacob avatar Aug 10 '23 17:08 rljacob

#5849 was merged. Status now?

rljacob avatar Sep 07 '23 17:09 rljacob

@glemieux is this ready?

rljacob avatar Sep 21 '23 17:09 rljacob

@glemieux is this ready?

@rljacob This is still WIP and waiting on https://github.com/NGEET/fates/pull/1040 updates. I'm actively working on this.

glemieux avatar Sep 21 '23 17:09 glemieux

update: still waiting on fates PR. Another couple of weeks.

rljacob avatar Oct 12 '23 17:10 rljacob

update: still WIP. 2 others will need to be merged before this.

rljacob avatar Nov 16 '23 18:11 rljacob

@glemieux can you list in a comment the PRs this is waiting on?

rljacob avatar Dec 04 '23 19:12 rljacob

@rljacob it needs to be staged after #6018 and #6027, both which need review and are undergoing some testing. Ultimately, it's also waiting on https://github.com/NGEET/fates/pull/1040, but this should be integrated within the next week.

This PR needs to have some updates brought in, but is close to not being "WIP".

glemieux avatar Dec 04 '23 22:12 glemieux

FYI: The next FATES API (33) is fairly simple, but I will hold on making that until this branch is re-based, since I have to build it on top of this one.

rgknox avatar Feb 05 '24 18:02 rgknox

  • [x] update fates tag
  • [x] add landuse testmod to fates test suite
  • [x] remove use_cn return check from landusemod
  • [x] add fluh_timeseries to setup_cmdl_fates_mode

glemieux avatar Feb 05 '24 18:02 glemieux

@peterdschwartz @rgknox I've taken care of the suggested changes and rebased this onto master now that #6027 is in. I'm going to start regression testing on this today and I've removed the '[WIP]'.

glemieux avatar Feb 07 '24 22:02 glemieux

@peterdschwartz regression testing on perlmutter with the e3sm_land_developer suite is complete and all expected non-fates tests are B4B. The qian smoke test from #6192 is failing, but that's because I hadn't rebased since last week. I've got a local rebased branch with #6219 included to make sure its not failing for a different reason. All fates test pass with expected DIFFs in non-landuse run modes since the tag update also includes a couple fates scientific bug fixes since sci.1.68.2_api.31.0.0.

glemieux avatar Feb 16 '24 19:02 glemieux

@rgknox @bishtgautam This is ready to review then.

Edit: Needs to be re-approved after rebase.

peterdschwartz avatar Feb 16 '24 19:02 peterdschwartz

Just a quick update to note that rebasing against the latest master resulted in SMS.r05_r05.I1850ELMCN.pm-cpu_....elm-qian_1948 passing.

glemieux avatar Feb 16 '24 23:02 glemieux

Tested on chrysalis and everything came back as expected. This can go in once it's got one approval

peterdschwartz avatar Feb 19 '24 19:02 peterdschwartz

However, a major comment is: Shouldn't there be a new compset (say I20TRELMFATES) in which the transient LU data is used by FATES?

@bishtgautam Eventually we should have a compset for this, but with this PR I don't think its ideal as we're going to be bringing in a fates landuse v2 change in the next month or so. I think with the v2 update we will want to facilitate easier use of the option through the compset.

On a related note and by comparison, I think its definitely worth creating a fates SP mode compset with a future PR since that run mode is more mature.

glemieux avatar Feb 22 '24 21:02 glemieux

Still waiting for the repo to be open.

peterdschwartz avatar Feb 26 '24 20:02 peterdschwartz

merged to next

peterdschwartz avatar Mar 05 '24 18:03 peterdschwartz