ipyparallel
ipyparallel copied to clipboard
HTCondor engines dont stop when using SSHProxyEngineSetLauncher
I'm using SSHProxyEngineSetLauncher to start an ipcluster on a remote machine which uses condor. When stopping SSHProxyEngineSetLauncher condor_q still shows ipengines in the queue.
I think this is because SSHProxyEngineSetLauncher kills the ssh connection which runs ipcluster. With this approach the ipcluster is not able to correctly shut down and kill the engines.
Maybe it is possible the send a shutdown signal before killing the connection
Was there any resolution to this issue @feanor12 ? Also wondering if you have docs on how you setup the IpyParallel cluster on the HtCondor pool.
I eventually switched to a python(actual working thing) + HtCondor approach, without ipengines. So I don't have a solution for the problem. Sorry