James Pirruccello

Hearing about the error you encountered, I ran another test and got an "exciting" result after about 8,000 ~1mb files were copied (out of ~80,000 files): ```sh Pausing command execution:...

After reinstalling gcloud so I could finally finish my download*, I was also able to get a couple of hash mismatches, though this only occurred in about 1 out of...

> [....] The Cloud team was able to root cause the problem; it was a fairly straight-forward failure case that needed a retry. The report is that the fix is...

I tried to describe the use case in the first post, but I can add more color if I did not convey the use case very well. Basically, this is...

The final jobs were launched at 2019-05-06 02:00:00 according to the pipelines tab, so 2:17 is pretty close to the right time to finish. These jobs each take < 60...

Just got bit by what seems to be the collision of (a) transient Google Storage errors occurring at (b) the end of a dsub / google pipelines job again. This...

Interestingly, this wasn't resolved by re-running. I confirmed that the disk is ~10x larger than the output files. However, only VMs running on the smallest files actually delocalize the complete...

Thanks for taking a look. I'm using the `google-cls-v2` provider which only allows me to fetch statuses for the past ~100 jobs (as far as I can tell) so this...

(Current working directory is `/mnt/data/workingdir`, so one hypothesis as to why this occurred -- that I was somehow working in a mounted bucket -- didn't pan out.)

Finally, I should add that, with a highly parallel workload, this affects the majority of my jobs. If this seems more like a gcsfuse-specific issue, I can move this over...