Matt Bookman

Hi Joe, Can you describe your goal here? The Pipelines API doesn't give you the error code from the command, so one doesn't typically build logic based on the failure...

Thanks for reporting, @carbocation. We could add error `99` to the list of [TRANSIENT_SOCKET_ERROR_CODES](https://github.com/DataBiosphere/dsub/blob/master/dsub/providers/google_base.py#L72) that are retried, although I'm at a loss to come up with a scenario in which...

Hi @sansarsecondary ! This particular message doesn't have any kind of guard around it to suppress it: https://github.com/DataBiosphere/dsub/blob/a01408d3769d93c3ae5c5f8ea1cdd0484dc15bd0/dsub/providers/google_v2_base.py#L922 ``` def _submit_pipeline(self, request): google_base_api = google_base.Api() operation = google_base_api.execute(self._pipelines_run_api(request)) print('Provider internal-id...

Hi @carbocation ! In reviewing this, we are a little unclear on where the failure is actually occurring. Do you have a log file from the VM, `dstat` error message,...

Hi @carbocation ! Can you explain the use case to copy the binary from a fuse-mounted bucket versus: 1- Putting the file in a docker image 2- Pulling the file...

Thanks for reporting this problem. `dsub` development of the local provider has been on linux, so we may find some small issues on other *nix-es. I reproduced the same problem...

If you are able to create a reproducible test case that demonstrates clearly that the file is in fact not being modified while you are trying to copy it, then...

Re-opening this as implicit documentation and as a reminder that we should either add real documentation or look into whether there is a platform-specific code change to make.

Thanks @pbilling for the detail on your use case. Doing a quick re-test on a VM (versus not have sufficient logging) makes a lot of sense. A couple of additional...

We would love for someone to contribute an AWS provider! We've got an architecture to support different providers and [documentation](https://github.com/DataBiosphere/dsub/tree/master/docs/providers) of the details of the environment that a new provider...