pySCENIC
pySCENIC copied to clipboard
CTX process gets killed
Hi , I have an issue and could not find the solution in the documentation.
When I run CTX it kills the process early on, because it thinks the workers are running out of memory. I do have a flexible memory, so if it is needed, it automatically increases it. This is why I changed my Dask settings so that it just continues to run without terminating the process when it thinks it runs out of memory.
However, I noticed in the latest updates that the CTX uses multiprocessing instead of Dask. How can I change the settings in multiprocessing, or how can I set the CTX function to use DASK instead?
You can add --mode dask_multiprocessing.
But probably you should limit the number of workers to a lower value (--num_workers) so you wouldn't run out of RAM in the first place.
thanks for your reply, I will add the mode dask to see if it changes.
I'm using a dynamic memory so in case it runs out, it should give me more RAM. But for some reason that does not seem to work out properly.
Why not give the proper amount from the start?
Are you running it in a VM?
Closing because of inactivity. Feel free to reopen.