grab-site icon indicating copy to clipboard operation
grab-site copied to clipboard

Published 20 hours ago • verified publisher icon ArchiveTeam

Dupespotter has false positives

Open ivan opened this issue 8 years ago • 1 comments

When archiving http://mirrors.pdp-11.ru/, dupespotter incorrectly reports a duplicate and fails to extract links:

DUPE http://mirrors.pdp-11.ru/ftp.cis.upenn.edu/
  OF http://mirrors.pdp-11.ru/ftp.mayn.de/

http://mirrors.pdp-11.ru/ftp.cis.upenn.edu/

http://mirrors.pdp-11.ru/ftp.mayn.de/

ivan avatar Aug 27 '15 04:08 ivan

I have added a --no-dupespotter option in 7a63a3dcd113e11de218fe6bb0c3ad03153a6954 and I might have it enabled by default in the future.

ivan avatar Sep 30 '15 22:09 ivan