noel

Adding that 3-line sort fix Luca found above does seem to help here. When I run the same 18-step tests of 2 cases (320 and 384 nodes on frontier), I...

I would recommend against using the special value of NaN for anything intentionally.

I would think that changes that are not expected to cause a problem would be OK. We don't need to be BFB right now with previous runs. But will let...

There are currently issues with ne120 on E3SM master (which started happening after v3atm merged in). I don't think they would impact scream (yet). Also, that error mesg above does...

I just tried ne120 with scream on pm-gpu and was able to run 5 days. I see on slack, Elynn noted that she sees the error after around 1 year...

I was running a separate case (to test restarts and general stability) that only differed in the opt level used in 2 files. And the case failed in the same...

From what @oksanaguba said, the branch we are using here`machines/frontier` was based off a scream repo of May 19th.

With updated repo, that we know at least corrects issue with monthly output, I have run ne1024 to 71 days so far. Not sure that proves we no longer see...

I have another case where this happened. This was on pm-gpu at ne120 with 32 nodes. I attempted to run for 1 year, with restarts every month. While writing the...

Thanks @lee1046 -- I do see that at least the most recent cases with this issue, it is hanging during the writing of `elm.h0.0001-01.nc` file at end of month. It...