Matt Bookman
Matt Bookman
Hi @ccario83 and @KarlKeat ! We have released [0.4.10](https://github.com/DataBiosphere/dsub/releases/tag/v0.4.10), which includes support for passing the user project to mounted buckets. When you get the chance, please confirm if it resolves...
Hi @carbocation ! A workaround for this is to make your `~/.config/gcloud` directory available inside the container. This can be done with: ``` --input-recursive CLOUDSDK_CONFIG_INPUT=${HOME}/.config/gcloud \ --env CLOUDSDK_CONFIG=/mnt/data/input/file${HOME}/.config/gcloud \ ```...
Hi @jacekzkominek , Sorry to hear about the battle with `multiprocessing`. Your note "this behavior is non-deterministic" is a painful part of multiprocessing and figuring out race conditions is often...
This is a good question @rivershah! For the `google-v2` and `google-cls-v2`, this would appear to be doable based on the following documentation: https://cloud.google.com/life-sciences/docs/reference/rest/v2beta/projects.locations.pipelines/run#action > **imageUri | stringRequired** > ....The image...
Thanks for the input @rivershah. A cursory look indicates that Batch supports this via the LocationPolicy: https://cloud.google.com/batch/docs/reference/rest/v1alpha/projects.locations.jobs#locationpolicy We'll test it out and look to wire it up if it works...
Hey @rivershah ! Sorry about the delay in following up. We did check in with the Batch team regarding this. The lack of the multi-region support is presently intentional in...
Thanks for the pointer, @carbocation ! dsub has been pinned to the same `gcsfuse` docker image for a while now: https://github.com/DataBiosphere/dsub/blob/main/dsub/providers/google_v2_base.py#L51 ``` # This image is for an optional mount...
Thanks for reporting that @slagelwa! Of course, we've encountered this issue with the BAM/BAI timestamps long ago, but not concurrent with the non-root Docker image. We should probably update `dsub`...
Thanks for the pointer @carbocation! We will take a look.
Overall, `gcloud storage` looks pretty good. The performance improvements are real and minimal code changes are needed to get them. That's pretty exciting. That said, I have twice (in only...