pySCENIC icon indicating copy to clipboard operation
pySCENIC copied to clipboard

CTX process gets killed

Open JensFGG opened this issue 3 years ago • 3 comments

Hi , I have an issue and could not find the solution in the documentation.

When I run CTX it kills the process early on, because it thinks the workers are running out of memory. I do have a flexible memory, so if it is needed, it automatically increases it. This is why I changed my Dask settings so that it just continues to run without terminating the process when it thinks it runs out of memory.

However, I noticed in the latest updates that the CTX uses multiprocessing instead of Dask. How can I change the settings in multiprocessing, or how can I set the CTX function to use DASK instead?

JensFGG avatar Sep 15 '22 08:09 JensFGG

You can add --mode dask_multiprocessing. But probably you should limit the number of workers to a lower value (--num_workers) so you wouldn't run out of RAM in the first place.

ghuls avatar Sep 15 '22 14:09 ghuls

thanks for your reply, I will add the mode dask to see if it changes.

I'm using a dynamic memory so in case it runs out, it should give me more RAM. But for some reason that does not seem to work out properly.

JensFGG avatar Sep 16 '22 07:09 JensFGG

Why not give the proper amount from the start?

Are you running it in a VM?

ghuls avatar Sep 16 '22 08:09 ghuls

Closing because of inactivity. Feel free to reopen.

SeppeDeWinter avatar Nov 21 '22 14:11 SeppeDeWinter