CAM icon indicating copy to clipboard operation
CAM copied to clipboard

Make st_archive archive CAM+DART output files

Open kdraeder opened this issue 8 months ago • 7 comments

What is the feature/what would you like to discuss?

Doing data assimilation with CESM+DART generates many new types of output files, which st-archive should archive, assuming they are named according to CESM conventions. Many of the new files will be handled by the esp component code, but others are more closely associated with the geophysical components and should be archived with their files. We've chosen new file names in such a way that this can be done with very small changes to $component/cime_config/config_archive.xml cime/CIME/XML/archive_base.py A second small change is to make st-archive handle compressed files (*.gz). This has no effect on model calculations or existing output.

The changes have been tested in cesm3.0_alphabranch and pushed to my github CAM fork, except for the ChangeLog, which wants a PR # (or Issue # ). I'll include more details in the PR, after someone tells me to proceed. Or I can provide them here.

I don't seem to have permission to select features; Labels, Projects, ...

Is there anyone in particular you want to be part of this conversation?

No response

Will this change (regression test) answers?

No

Will you be implementing this enhancement yourself?

Yes

kdraeder avatar Apr 22 '25 20:04 kdraeder

@kdraeder - Feel free to open a PR to cam_development. We will then perform a review and can work on bringing it into CAM. If you feel comfortable giving me write permission to your fork, I can make the edits we'll need to make directly in your fork. Otherwise, I can open a separate PR which merges your branch into my fork

cacraigucar avatar Apr 23 '25 19:04 cacraigucar

@cacraigucar This PR is ready. I helped Kevin resolve merge conflicts this morning and suggested that he not try to update the ChangeLog himself. Can you please schedule this for your next tag? Thanks

jedwards4b avatar Jun 24 '25 17:06 jedwards4b

@cecilehannay - Can you please run your test once again and confirm this works for your case?

cacraigucar avatar Jun 24 '25 17:06 cacraigucar

@cecilehannay @cacraigucar Just checking to see whether you've had a chance to run this test. Thanks

kdraeder avatar Jul 09 '25 20:07 kdraeder

@cecilehannay @cacraigucar Just checking to see whether you've had a chance to run this test. Thanks

Cecile has it on her to-do list, but she has been swamped with CESM3 runs and has not had time yet

cacraigucar avatar Jul 10 '25 20:07 cacraigucar

@cacraigucar Is it a test that I could run? Or is the context too complicated?

kdraeder avatar Jul 24 '25 21:07 kdraeder

I really do want @cecilehannay to confirm the changes are okay with her - I don't know what she ran originally. I'll reach out to her again, but I know she's been extremely busy.

cacraigucar avatar Jul 24 '25 22:07 cacraigucar