Peter Rowlands (변기호)

DVC should work properly with the virtual-host style endpointurl addressing. The error indicates that you don't have the right permissions to access that bucket. Are you able to use the...

In botocore it defaults to `auto`, where if you are setting an endpointurl it uses virtual style and then falls back to path https://github.com/boto/botocore/blob/e7c5b6ab22174797db551f44053a0b2245430649/botocore/utils.py#L2604-L2614

The error given with s3fs/DVC is a permission error when accessing a specific file. It does not look like s3fs is not failing to create the client session (InvalidPathAccess is...

This looks to me like it may be an aiobotocore or botocore bug since their behavior to default to virtual host addressing and fall back to path addressing may not...

> Also, I believe I have to explicitly add the path to the params file under the params keyword when I am running the stage from a different working directory...Not...

> Is it then possible to specify the params path on the entire pipeline level? I could them simply write a simple loop in a shell script to go through...

This issue is on our roadmap and will likely be addressed at the same time as https://github.com/iterative/dvc/issues/829. When we have support for chunking in DVC, we will move away from...

@mnrozhkov can you run this command in that git repo and post the output (it shouldn't matter which dvc subrepo you are in) ``` git show-ref pucka-navy ```

Regarding GCS, the default method of uploading files in chunks for GCS requires that chunks be uploaded in order sequentially, which is what gcsfs does now (see chunked/streaming uploads in...

The s3 changes have been merged upstream and will be available in the next s3fs release. I'll leave this issue open since it's still not addressed for google cloud storage,...