Ben Sherman

Results 112 issues of Ben Sherman

Spun off from #3849 without the WIP resumability piece.

Google Batch now supports container streaming (i.e. lazy loading container images) which improves startup time and reduces overhead, especially for fine-grained workloads. https://cloud.google.com/batch/docs/use-image-streaming For us to support it in Nextflow...

executor/google-batch

Alternative to #3818 Instead of adding a `temporary` option to output paths, this PR facilitates the automatic cleanup through the `cleanup` config option. By setting `cleanup = 'eager'`, Nextflow will...

Close #4033 This PR attempts to resolve some quirks with the params map by separating the alias behavior from the read-only behavior. It adds an `AliasMap` which can be used...

Spun off from #4372. Consider the following configuration: ```groovy process { cpus = 2 memory 4.GB // incorrect } ``` Omitting the `=` in a config setting should lead to...

error-improvements
dsl-improvements

Close #4422

lang/config
lang/modules

Close #4031 Files that match a process output are tagged by Fusion as `nextflow.io/output`. For other files tagged as `nextflow.io/temporary`, Fusion can try to cache them locally instead of uploading...

storage/fusion

Close #4104 and #4637 I would prefer to be aggressive here and unwrap the group key by default because it will almost always be the desired behavior. But I will...

lang/operators

Nextflow should be able to automatically generate stub scripts for processes based on declared outputs. Basically a bash script that does `touch ` for each declared output file. For glob...

This PR adds a workflow output definition based on https://github.com/nextflow-io/nextflow/pull/4784. I'm still working through the pipeline, but once I'm done, I will have completely replaced publishDir using the output DSL....