skshetry

> Is there any idea of what this will mean for performance? We already use `localfs` on data-management systems or wherever we are filesystem agnostic. > Is this something you...

My understanding here is that fsspec does not have a good way to check for authentication issues. It may raise `OSError` on auth issues, but lots of `api` have assumptions...

> The OSError you've mentioned is just a bug, we've discussed this before. I'll consider this as a https://github.com/iterative/dvc/labels/feature%20request rather than a https://github.com/iterative/dvc/labels/bug. > What's important to remember here is...

Regarding pipelining, as @pmrowla said, it's not very well supported, and users will run into issues with proxy as well. [buggy proxies, marginal improvements, HOL blocking ...](https://developer.mozilla.org/en-US/docs/Web/HTTP/Connection_management_in_HTTP_1.x#http_pipelining) It's considered a...

> Are we planning to migrate http to fsspec and/or optimize it? I think moving to `fsspec`'s HTTPFileSystem is the plan. Right now, I think it's not possible to upload...

> I don't know the case for S3, probably the limit is much higher or it's only limited by the bandwidth, but [HTTP/1.1 protocol](http://tools.ietf.org/html/rfc2616#section-8.1.4) doesn't allow more than 2 connections...

I have been considering not-in-cache to be all edge-cases, we want to be correct first, that's why we tried to fix it in the best possible way. This with `--add-commit`...

Another thing is, in a distributed context, `dvc data status` will always show the same results/state regardless of the cache for a particular repo. Does it matter for the index?...

> I think we need separate flags for saving the md5 and not saving it, but both should be uncommitted. What's the usecase where you want to save the hash...

@arthurkok2, could you please share `.dvcignore` file or try removing certain items of it to see what is causing this?