gridmap
gridmap copied to clipboard
pygridtools
Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).
`python3.6/runpy.py:125: RuntimeWarning: 'gridmap.runner' found in sys.modules after import of package 'gridmap', but prior to execution of 'gridmap.runner'; this may result in unpredictable behaviour warn(RuntimeWarning(msg))` I don't know how to remove...
Hi Dan, I have modified code to include a queue for maximum number of jobs to run on the cluster at any time. Please find below a summary of the...
When apply to some SGE environments, especially some jobs do need to be run in multi-processes mode，the number of processes need to be requestable and consumable as the key complex...
First off, thanks for the nice package. I noticed the documentation https://gridmap.readthedocs.io/en/latest/gridmap.html is missing the `project` option, which is indeed implemented in the code (version `0.15.0`) 
However, the requirements do not mention cherrypy at all. This should be resolved plus the code in gridmap.web should be updated to make sure it's compatible with the latest version...
If not enough resources are provided for the job (eg., using 'h_rt=00:00:01' in the `map_reduce.py`), I don't get automatic resubmissions via the `handle_resubmit` function, but rather: ``` 2020-04-23 12:53:33,683 -...
Currently, we can only customize resource requests in a few different ways, such as specifying the number of GPUs, the host, etc. But this is only the tip of the...
Python 3.7.6, running example: ``` sending function jobs to cluster Traceback (most recent call last): File "testb.py", line 113, in main() File "testb.py", line 105, in main job_outputs = process_jobs(functionJobs,...
Relates to #84 We should start making the Conda packages ourselves and putting them up on the `ets` channel.
Metadata
Owner
Metadata
Easily map Python functions onto a cluster using a DRMAA-compatible grid engine like Sun Grid Engine (SGE).