wget2 icon indicating copy to clipboard operation
wget2 copied to clipboard

not downloading all files, -R not working, many errors

Open joaoluizcarvalho opened this issue 8 months ago • 6 comments

Every month I download the new set of Mame roms from bda.retroroms.info using the following command:

wget -r --level=1 -np -nH -nc --cut-dirs=2 --http-user=myusername --http-password=mypassword -R "index.html*" -R "desktop.ini" https://bda.retroroms.info:82/downloads/mame/mame-0266/

However, since Fedora upgraded to wget2, I have been observing the following issues:

  1. Prompt says "Errors: 100+"
  2. Only a small subset of the files in the directory is downloaded. If I delete the folder, and run again, a different subset is downloaded each time.
  3. The -R option doesn't seem to be working, because the index.html files are kept.

Here is an example prompt output:

9 files 100% [===========================================================================================================================================================================================>] 2.19M 1013KB/s 11 files 100% [===========================================================================================================================================================================================>] 20.83M 1.38MB/s index.html?C=M&O=D 100% [===========================================================================================================================================================================================>] 2.16K --.-KB/s index.html 100% [===========================================================================================================================================================================================>] 607 --.-KB/s zerotimeb.zip 100% [===========================================================================================================================================================================================>] 494 --.-KB/s [Files: 23 Bytes: 22.98M [1.23MB/s] Redirects: 0 Todo: 0 Errors: 113

Note that only 23 files were downloaded, but the directory I requested had 67 files and 1 empty folder. The complete file list can be seen here, by browsing into /downloads/mame/mame-0266/

joaoluizcarvalho avatar Jun 02 '24 23:06 joaoluizcarvalho