CMEPS icon indicating copy to clipboard operation
CMEPS copied to clipboard

Make st_archive archive CESM+DART output files, especially coupler history files

Open kdraeder opened this issue 8 months ago • 6 comments

Doing data assimilation with CESM+DART generates many new types of output files, which st-archive should archive, assuming they are named according to CESM conventions. Many of the new files will be handled by the esp component code, but others are more closely associated with the geophysical components and should be archived with their files. We've chosen new file names in such a way that this can be done with very small changes to $component/cime_config/config_archive.xml cime/CIME/XML/archive_base.py The cmeps/cime_config/config_archive.xml change is focused on archiving the coupler history files, which are very useful for doing data assimilation with surface models. A second small change is to make st-archive handle compressed files (*.gz). This has no effect on model calculations or existing output.

I developed and tested the changes in a recent (2025-4-22) cesm3.0_alphabranch. I've committed them to a feature branch based on master and pushed it to my fork of CMEPS. I can include more details here, or in a PR when it's time for that.

I don't have permission to add Assignees, Labels, etc., so I'm hoping that someone will fill those in, or give me permission to.

kdraeder avatar Apr 22 '25 22:04 kdraeder

@cacraigucar I've seen your name listed as someone who organizes assignees for issues in some parts of CESM. Is CMEPS one of those? Thanks, Kevin

kdraeder avatar May 06 '25 15:05 kdraeder

No - you will need to reach out Jim Edwards for CMEPS, I believe

cacraigucar avatar May 06 '25 16:05 cacraigucar

@jedwards4b Cheryl suggested that you organize assignees for CMEPS issues. If so, please assign someone to this one, or give me permission to assign the right column items. Thanks, Kevin

kdraeder avatar May 06 '25 16:05 kdraeder

@kdraeder it looks like I have permission, so I assigned this to you. Do you have specific labels you'd like applied as well?

mnlevy1981 avatar May 06 '25 17:05 mnlevy1981

@mnlevy1981 Thanks for offering! I can't see the list, but this is an enhancement and not complicated (other than the python parsing of regular expressions!). It only involves st_archive.
It's motivated by DART, but I think it applies to any run which needs to archive coupler history files. So please add any labels that look appropriate.

kdraeder avatar May 06 '25 18:05 kdraeder

@jedwards4b reviewed the change and said to open a PR.

kdraeder avatar May 06 '25 19:05 kdraeder