nextflow icon indicating copy to clipboard operation
nextflow copied to clipboard

POC: Support pipeline archives instead of git repos or local paths

Open adamrtalbot opened this issue 6 months ago • 2 comments

This adds support for using archives of pipelines instead of git repos for remote use. This is useful because it bypasses remote git which can be problematic in secure environments or when hitting rate limits. To use, you can run nextflow run https://url.com/path/to/archive.tar.gz which will download the files to artefacts and run them. We could imagine something like Seqera Platform serving secure URLs to Git archives to allow users to use a repo without granting them access to the repo itself. The main downside of this is it might encourage bad practice, where users will use this in preference to a Git repo where they should do the majority of their work.

Supporting artefacts instead of cloned repos is an idea I've been noodling around with - it might provide another way to deploy and manage collections of pipelines in Nextflow where we don't have to treat everything as a Git repo.

I'm aware this is pretty crude.

adamrtalbot avatar May 16 '25 13:05 adamrtalbot

Deploy Preview for nextflow-docs-staging canceled.

Name Link
Latest commit 5c895edd1d6299d1d14967884c78256e7bd0d143
Latest deploy log https://app.netlify.com/projects/nextflow-docs-staging/deploys/6846d80305c7a100083b73dc

netlify[bot] avatar May 16 '25 13:05 netlify[bot]

Between this and the plugin registry, we're just getting closer and closer to a pipeline registry...

bentsherman avatar May 16 '25 23:05 bentsherman