dockerflow
dockerflow copied to clipboard
Dockerflow is a workflow runner that uses Dataflow to run a series of tasks in Docker with the Pipelines API
Hi @jbingham - "error": { "code": 400, "message": "Invalid value for field \"parameter.defaultValue\": too long: 1471 bytes, want no longer than 1024 bytes", "status": "INVALID_ARGUMENT" } Just so you know,...
Hi @jbingham - Canceling the pipeline using "stop job" feature on Dataflow UI, terminates the master. However, if there are any instances running (vms with name ggp*), they are not...
Eg, suppose there are 2 input parameters: sampleName: x, y, z inputFile: fileX, fileY, fileZ It would be nice to be able to scatter by [x, fileX], [y, fileY], [z,...
Workflows can include steps that are defined in separate files. It would be nice if they could include entire workflows as steps, loaded from separate files. Note: this functionality used...
I am working with a software package that takes as a parameter the name of an output directory. Then, a bunch of files are written to that output directory. I...
Is there any support being build or that exists to run a CWL-defined workflow using dockerflow?
HttpUtils uses hand-coded URL strings with auth, rather than the Google Java Client for GCS, which is the preferred way to read files.