skshetry

Hi, @johnyaku. What commands are you using? Also, I would appreciate a profiling data to see what is slow. Also, I am curious what the performance was like before index...

@johnyaku, one tip: if `dvc add` is being slow, you can now selectively update the datasets which should be a bit faster if the changes are small/limited. eg: if the...

> I'm interpreting your comment as meaning that I can just `dvc add a/c` rather than having to match the `a.dvc` file and run `dvc add a`. Is this correct?...

Looking at the profiling data, most of the time is spent hashing here. On a total runtime of 1505s, 75% of the time was spent hashing 475 files (2.3s/file) and...

> Confusing error messages and inadequate configuration validation can lead to a poor user experience when working with remote storage providers. The current error messages are not always clear or...

> There may be opportunities to improve configuration validation to ensure that all necessary settings are properly configured before use. Most of those are runtime validations. It may be difficult...

I don't think we need a meta issue, and the problems are being tracked on individual issues. Closing...

This is something that was supported accidentally. I don't think we should support symlink to a dvcfile at all. There are potential security concerns regarding that.

> Why accidentaly? There was explicit realpath everywhere in the code... The `realpath` was everywhere because `dvc_repo.root_dir` was also a realpath forcing us to make everything else a realpath, mostly...

Closing, this is intentional. `pretty_exc` is a hack, and we have to be careful working around that.