ipyparallel
ipyparallel copied to clipboard
ipython
IPython Parallel: Interactive Parallel Computing in Python
There is a race where engine connections to schedulers takes a finite amount of time, and it is possible for clients to be informed of an engine's registration *before* the...
Hey @minrk and folks, in Issue #141 you recommend to use os.kill to interrupt engines by pid. I've been trying this approach, however, it seems that when engines are killed...
The Cluster API traps stdout/stderr of controller and engines because it's meant to be used interactively. But that's where information about why connection failures occurred is going to be, and...
This issue may be related to https://github.com/ipython/ipyparallel/issues/207 which is also not marked as solved, yet. Also I posted this problem on stackoverflow (https://stackoverflow.com/questions/45781545/ipyparallels-loadbalancedview-bloats-memory-how-can-i-avoid-that). I want to execute multiple tasks in...
It would be great, when possible, to use a callback hook in launchers to signal when a launcher is ready. This could be used to return connection info from the...
We have landed the prototype BroadcastScheduler for improved scaling of DirectView-style message patterns (same request to all engines), but there's still quite a bit to do. Still to do to...
Hey guys very very cool job so far. I'm not quite sure if that's a hugh issue, but I wasn't able to find a solution by myself. Goal: I want...
Hi, I couldn't find the answer in the docs so asking here. What is the max number of engines I can run simultaneously in my cluster? I don't mean in...
There is a bug in the random_dag function of https://ipython.org/ipython-doc/3/parallel/dag_dependencies.html The solution is to add the following line: if G.has_edge(a, b):continue before: G.add_edge(a,b)
I find that there is no way to query if the cluster is still live, and any tasks submitted will hang with no method for checking connection status. Is there...
