ert icon indicating copy to clipboard operation
ert copied to clipboard

PlotAPI may timeout for setups seen in real use

Open eivindjahren opened this issue 2 years ago • 9 comments

The following error condition can seemingly be hit by users which have large setups:

https://github.com/equinor/ert/blob/924e13b7d2abe8d1de1b4a17dceeabf7b400b652/src/ert/gui/tools/plot/plot_window.py#L91-L95

eivindjahren avatar Mar 10 '23 10:03 eivindjahren

We have seen this traceback in real usage:

None of the URLs provided for the ert storage server worked.
Traceback (most recent call last):
 File "/.../ert/gui/tools/plot/plot_window.py", line 53, in __init__
   self._api = PlotApi()
 File "/.../ert/gui/tools/plot/plot_api.py", line 21, in __init__
   self._reset_storage_facade()
 File "/.../ert/gui/tools/plot/plot_api.py", line 24, in _reset_storage_facade
   with Storage.session() as client:
 File "/.../ert/services/storage_service.py", line 89, in session
   base_url=inst.fetch_url(), auth_token=inst.fetch_auth()[1]
 File "/.../ert/services/storage_service.py", line 77, in fetch_url
   raise TimeoutError(
TimeoutError: None of the URLs provided for the ert storage server worked.

eivindjahren avatar Mar 14 '23 13:03 eivindjahren

Could this be because observation loading is slow? I remember we once doubled the timeout of initializing dark_storage, because it spent a minute parsing some observation file.

mortalisk avatar Apr 13 '23 11:04 mortalisk

Are you sure it is only for large setups ? I had a similar error message "None of the URLs provided..." when running drogon (and all other models), and I learnt from another user with the same problem it was related to a proxy setting in one of my startup files .bashrc or .profile, so when I removed that everything was fine.

tralsos avatar Apr 14 '23 07:04 tralsos

Good point @tralsos . @eivindjahren do you think it is possible to distinguish ( and advice the users ) between a "real" bug and the proxy-errors? Now we are treating RequestError and TimeoutErrors the same way.

oysteoh avatar Apr 19 '23 10:04 oysteoh

I am not sure. I think we would require some assistance from e.g. @oyvindeide

eivindjahren avatar Apr 19 '23 12:04 eivindjahren

@eivindjahren you have assigned yourself to this, do you know if it is still a problem? Is the current criticality high relevant?

oysteoh avatar May 11 '23 06:05 oysteoh

I will have another look at whether this is a problem on Troll, if it is I think I will have to unassign myself as I have no way of reproducing the failure.

eivindjahren avatar May 11 '23 07:05 eivindjahren

Tested this recently, and is still happening.

oyvindeide avatar Jan 30 '24 07:01 oyvindeide

This should be ~twice as fast now, but we will have to test with troll before we know for sure.

eivindjahren avatar Feb 27 '24 09:02 eivindjahren

Just got confirmation that this is still the case

eivindjahren avatar Aug 20 '24 19:08 eivindjahren