cloud versioning

Open dberenbaum opened this issue 3 years ago • 4 comments

Add benchmarks for cloud versioning remotes

Jan 12 '23 20:01 dberenbaum

Might be worth putting these per every plugin (e.g. into dvc-s3 for s3) and test particular functionality (like index building). Testing all clouds in dvc-bench might be an overkill, this didn't work out well with previous version of dvc-bench.

Jan 12 '23 21:01 efiop

True, that could be nice, but I was thinking of just testing in s3 like we do for regular remotes to make sure the basic workflow has reasonable benchmarks in line with traditional remotes.

Jan 13 '23 18:01 dberenbaum

Sorry, my mistake here. I guess we don't test s3 for regular remotes with dvc-bench now. So maybe we either need to test on at least one cloud remote or indeed move this to each plugin.

Jan 17 '23 16:01 dberenbaum

Though we have the infra in dvc-bench for running with different clouds, so maybe should fit in here after all.

Mar 15 '23 16:03 efiop