probe-scraper icon indicating copy to clipboard operation
probe-scraper copied to clipboard

Only checkout git repos once

Open relud opened this issue 4 years ago • 1 comments

when a git repository is specified multiple times in repositories.yaml it is cloned separately for each instance. Given the size of some of these repos, and the likelihood of repeatedly referenced repos being large, we should make sure each repo is only cloned once.

relud avatar Nov 01 '21 19:11 relud

Anything that speeds up the probe scraper job would be welcome, especially when debugging issues like https://bugzilla.mozilla.org/show_bug.cgi?id=1744585

wlach avatar Dec 07 '21 12:12 wlach