dvc-bench icon indicating copy to clipboard operation
dvc-bench copied to clipboard

benchmark: add dvc repo with 20000 stages/dvcfiles

Open efiop opened this issue 5 years ago • 2 comments

SC use case.

efiop avatar Jun 16 '20 15:06 efiop

We should start with 10-100 stages for now, 20000 stages to always test is crazy. The "levels of 10" benchmarks should give us pretty good results, which we can extrapolate to 20000. It is just too much.

skshetry avatar Jun 19 '20 06:06 skshetry

For the record: need to get back to this after pytest-benchmark migration, we need to start with making dataset testing comfy first and then we could do the same for dag https://github.com/iterative/dvc-bench/issues/294

efiop avatar Aug 12 '21 01:08 efiop