What we can learn from nextflow

[BoPeng]

Nextflow has been used on AWS batch and other environments, and we are still catching up. I think we will need to checkout how nextflow handles S3 etc and figure out what we can learn from it.

One thing that nextflow is doing well is to be able to specifify step-wise containers ..., which we do it inside a .sos script. The problem is that we do not have the concept of a "process" so cannot actually specify that in config file.

https://genomics-nf.workshop.aws/ would be a good tutorial.