Remove analysis update writing to storage while updating

Open oyvindeide opened this issue 3 years ago • 4 comments

Today the update algorithm will save and load parameters to storage while updating. We should replace this with keeping them in memory, and only writing once the update is completed.

May 12 '22 11:05 oyvindeide

Or at least explore how much memory this will require on a large case.

May 30 '22 13:05 oyvindeide

Blocked by: 3487

Jun 15 '22 11:06 oyvindeide

If this proves to be infeasable because the memory required is too large, we could consider using some other temporary storage.

Jun 15 '22 11:06 oyvindeide

No longer considered blocked, this should be as contained as possible if we have to revert it if it actually consumes too much memory.

Jul 27 '22 11:07 oyvindeide

Are we talking about these or something else?

https://github.com/equinor/ert/blob/bcc93d8cf92238187bfa6c996b64d0584f85d1ae/src/ert/analysis/_es_update.py#L108-L113

https://github.com/equinor/ert/blob/bcc93d8cf92238187bfa6c996b64d0584f85d1ae/src/ert/analysis/_es_update.py#L125-L131

Sep 21 '22 10:09 dafeda