ganga

ganga copied to clipboard

[Snakemake](https://snakemake.readthedocs.io/en/stable/) is increasingly used for configuring the whole workflow of a data analysis pipeline. At the moment, processing done by Ganga doesn't fit into this working pattern. It should be...

egede

respiting of a subjoin always fails

3

Dear developers! Using the latest released ganga version 8.7.8 a respiting of a job always fails. Earlier versions did not have this issue. Could you please have a look? Thx!...

heistera

Is it worth revisiting if this could be a possibility. Given how complicated analyses are becoming submitting enormous numbers of toy jobs will surely become necessary.

mesmith75

It is still too slow. There are probably things we can do to speed it up.

mesmith75

Not reliably reproducible but here is a stack trace: ``` ERROR Exception in callback DiracBase.requeue_dirac_finished_jobs..(>) at /cvmfs/ganga.cern.ch/Ganga/install/8.7.6/lib/python3.11/site-packages/ganga/GangaDirac/Lib/Backends/DiracBase.py:1437 handle: ) at /cvmfs/ganga.cern.ch/Ganga/install/8.7.6/lib/python3.11/site-packages/ganga/GangaDirac/Lib/Backends/DiracBase.py:1437> Traceback (most recent call last): File "/cvmfs/ganga.cern.ch/Ganga/install/micromamba_el9/lib/python3.11/asyncio/events.py", line 80,...

mesmith75

runMonitoring take more types addition

2

The issue solved was to make `runMonitoring` accept different job inputs—specifically, an integer (job ID), a list of integers (job IDs), and a job object—in addition to the original job...

saadkhi

Removing jobs, or output data from the grid takes forever and I think hangs. We should see if we can speed it up.

mesmith75

Make `runMonitoring` take more types

6

Currently `runMonitoring` only takes job slices. Would be nice to have it accept an `int`, or a list of `int` or a `job` object.

mesmith75

Jobs master kill broken

1

Again. Assume there is some change in Dirac: ```python [10:04:01] Ganga In [26]: jobs(162).kill() ERROR failed to kill job 162: BackendError: Dirac failed to kill jobs [951116631] (Dirac backend) ERROR...

mesmith75

``` /pool/condor/dir_1069554/./Ganga_0_hammer_weighting_-_2017_MagUp:160: SyntaxWarning: invalid escape sequence '\$' wrapperFile.write( 'echo "\${BASH_ENV}: ${BASH_ENV}"\n' ) /pool/condor/dir_1069554/./Ganga_0_hammer_weighting_-_2017_MagUp:163: SyntaxWarning: invalid escape sequence '\$' wrapperFile.write( ' echo "*** Warning: \${BASH_ENV} file not found ***"\n' ) ```

mesmith75