Matt Bookman
Matt Bookman
Experimental support for mounting a PD built from a Compute Engine Image has been added in [release 0.2.4](https://github.com/DataBiosphere/dsub/releases/tag/v0.2.4), specifically with change https://github.com/DataBiosphere/dsub/pull/139/commits/0c4a93a59dc5e00100e1e4edae761ee7e761bddd. Let us know how this goes.
Hi @michaeleekk ! The way to do this (as is supported by the [Lifescienes API](https://cloud.google.com/life-sciences/docs/reference/rest/v2beta/projects.locations.pipelines/run#Disk)) is to create a disk with the resources file(s) and then create a GCE Image...
Thanks for the pointer @hnawar ! I had not seen the ExistingDisk support added (late 2020). We'll look at extending the `--mount` flag to take advantage of the capability.
Release https://github.com/DataBiosphere/dsub/releases/tag/v0.4.7 adds support for the ExistingDisk by extending the URL formats recognized with the `--mount` flag. Heres the change: https://github.com/DataBiosphere/dsub/commit/2d0b808def65bc6100e4da81d9f82e241bbfb8c9 Please take a look and let us know how...
Hi @vandhanak, Unfortunately, the [Pipelines API](https://cloud.google.com/life-sciences/docs/reference/rest) has no way of updating the [timeout](https://cloud.google.com/life-sciences/docs/reference/rest/v2beta/projects.locations.pipelines/run#Pipeline) parameter after submitting the pipeline. Really hope your job ends up finishing!
This has been discussed in the past for the Pipelines API. I did not find an internal feature request to track this, so I have filed one.
Hi @carbocation ! What is the use case for requesting that the same bucket be mounted twice? I have concerns that GCSfuse is already a fragile enough solution that having...
Can you describe in more detail what it is that you are looking to do? The [pipelines.run](https://cloud.google.com/genomics/reference/rest/v2alpha1/pipelines/run) API indeed does not support running with `--privileged`. I can't speak for the...
Hi @de-code! `dsub` has thus far tried to really focus on simplicity with its interface (the command line and optional TSV file) to make it easier for scientists and computational...
Got it. I let's leave this open and we will document that buckets should only be mounted once and that people should use `--env` variables to point to specific locations...