mirror icon indicating copy to clipboard operation
mirror copied to clipboard

More verbosity and delayed retries

Open Stef-33560 opened this issue 3 years ago • 0 comments

This PR adds

  • [x] more retries, with delay For a reason that I can't explain when has_v1_mirror is true, some downloads fails, it seems that retrying immediately doesn't helps to recover everytime the things. Adding a fixed pause (i.e. : 1 second in commit 1066162) does not seems to be always sufficient. Calming more and more down the little :rabbit: forces him to gather things much better ! :stuck_out_tongue_winking_eye:
  • [x] verbosity (while using -v)

Output show between between brackets show the number of retries.

  • time ./mirror --v2 -v, from empty folder, started 2021-06-12T09:29PM UTC,

Seen at the end of the process :

....MMR[1]R[1]R[1]R[1]R[1]R[1]R[2]R[2]R[2]R[2]R[2]R[2]R[3]R[3]R[3]R[3]R[3]R[3]R[4]R[4]R[4]R[4]R[4]R[4]R[5]R[5]R[5]R[5]R[5]R[5]R[6]R[6]R[6]R[6]R[6]R[6]R[7]R[7]R[7]R[7]R[7]R[7]R[8]R[8]R[8]R[8]R[8]R[8]R[9]R[9]R[9]R[9]R[9]R[9]R[10]R[10]R[10]R[10]R[10]R[10]?????? Downloaded 611665 files real 33m23,535s user 9m41,809s sys 2m5,659s

  • time ./mirror.php --resync -v started at 2021-06-1210:16PMUTC Seen at the end of the process :

---R[1]R[1]R[1]R[1]R[1]R[1]R[2]R[2]R[2]R[2]R[2]R[2]R[3]R[3]R[3]R[3]R[3]R[3]R[4]R[4]R[4]R[4]R[4]R[4]R[5]R[5]R[5]R[5]R[5]R[5]R[6]R[6]R[6]R[6]R[6]R[6]R[7]R[7]R[7]R[7]R[7]R[7]R[8]R[8]R[8] R[8]R[8]R[8]R[9]R[9]R[9]R[9]R[9]R[9]R[10]R[10]R[10]R[10]R[10]R[10]?????? Downloaded 611667 files

real 27m6,411s user 7m5,421s sys 1m5,743s

The mirror is fully operationnal

composer config repos.packagist composer https://mirror-composer.lan/
composer require drush/drush

[...] 14 package suggestions were added by new dependencies, use composer suggest to see details.

Stef-33560 avatar Jun 10 '21 20:06 Stef-33560