gridmap

gridmap copied to clipboard

Add an option to return job exception instead of aborting all jobs

1

[GridMap kills all jobs](https://github.com/pygridtools/gridmap/blob/5ce50bc76e6a19d044faf1a73ae1cc3f3a3670cc/gridmap/job.py#L322) if [one of them fails](https://github.com/pygridtools/gridmap/blob/5ce50bc76e6a19d044faf1a73ae1cc3f3a3670cc/gridmap/job.py#L491). In some settings, like in my gridjug add-on, exceptions are OK as other jobs would take over.

andsor

Move the wiki info to the main documentation

1

Hi @dan-blanchard , I just came across the [wiki page](https://github.com/pygridtools/gridmap/wiki/How-GridMap-works-under-the-hood) for the first time and I would like to suggest to move it to the main docs, as it is...

andsor

Setting up JobMonitor Hanging

5

``` ===================================== ======== Submit and Wait ======== ===================================== sending function jobs to cluster 2015-07-21 18:15:13,077 - gridmap.job - INFO - Setting up JobMonitor on tcp://X.X.X.X:37905 ``` Do I need to...

cancan101

Potential extension to the library

2

Hello... Edit: I just realized that there is a related issue already opened: Add support for limiting the number of concurrently executing jobs #27. I believe this is also what...

sandeepklr

``` python import gridmap def dummyfunc(whatever): return whatever + 1 results = gridmap.grid_map(dummyfunc, range(10)) print results ``` While it's obviously best practice to have code inside main() or some other...

conorsleith

Gridmap with large output objects

1

When large output objects are generated by the jobs that are run on a cluster node, `JobMonitor` is unable to keep up with the flow of incoming information. The consequence...

bjanssen

Classes in __main__ modules will not work as arguments.

1

I'm not sure if this is a bug or just a limitation at this point, but if you have an executable script that defines a class in it, and then...

dan-blanchard

It would be great if you can add an optional waiting time between job submit. It is easy to do it manually (what I do) but perhaps it can be...

ghost

The `JobMonitor` gets heartbeats every couple seconds with CPU and memory usage info from all of the jobs, so it would be nice if there was an easy way to...

desilinguist

Currently `_send_zmq_msg` creates a new connection to the `JobMonitor` every time, which is really wasteful. Doesn't affect performance much since we only check things every ~15 seconds, but it would...

dan-blanchard