Samuel Lampa

Hi @chrstn-hntschl! I don't know how I have managed to miss your issue :confused: ... Did you solve this? There is an inherent problem in Luigi that scheduling and running...

(Hi, sorry, have been a bit busy, will look at this now!)

> I had difficulty finding a good naming convention for all my out_xxxx path, when my workflow would become complicated (e.g. with one task taking three other tasks as input:...

> I made a quick fix by changing line 147 of slurm.py from self.log_slurm_info(stderr) to self.log_slurm_info(str(stderr)).. It works, but I have no idea whether it will break in other circumstances....

> I have been looking at what's the best way do convert to string, some people suggest .decode('utf-8') (like in the quoted answer), others simply .decode() or str() without specifying...

Hi @hbredin! Interesting use case, it sounds [very similar](https://www.researchgate.net/publication/282870339_Poster_Using_workflow_tools_to_streamline_bioinformatics_computing_on_high-performance_e-infrastructures?channel=doi&linkId=5620f2d208aed8dd19426f09&showFulltext=true) to what we are doing with machine learning in drug discovery / cheminformatics! It sounds like you are basically looking for...

Hi @pietromarchesi and sorry for the lack of documentation on SLURM. Contributions very welcome, e.g. for the [wiki](https://github.com/pharmbio/sciluigi/wiki/Using). For now, you could have a look at our use case project...

> I could write up a draft for a doc page where I extend the example workflow of this examples with the necessary modifications necessary to run on SLURM, if...

> I am noticing that the workflows get shipped always to the same node (instead of being sent as batch jobs to different nodes). How many cores per node are...

> Interestingly, jobs still appear sequentially in the queue, as if SciLuigi was waiting for one workflow to be completed before creating the allocation for the next. Hmm, are you...