dweb-mirror icon indicating copy to clipboard operation
dweb-mirror copied to clipboard
verified publisher icon internetarchive

Crawling fails - leaving tasks

Open mitra42 opened this issue 5 years ago • 2 comments

Crawling fails on two of the the edge cases in https://github.com/internetarchive/dweb-archive/issues/120. In both cases, presence in the crawl causes left over tasks

  • [ ] bdc-W3PD1123
  • [ ] JournetsinPersiaAndKurdistanVolII

mitra42 avatar Feb 29 '20 09:02 mitra42

I ntoice errors also in browser for https://www-dweb-mirror.dev.archive.org/services/img/bdc-W3PD1123 and https://www-dweb-mirror.dev.archive.org/services/img/JournetsinPersiaAndKurdistanVolII

mitra42 avatar Feb 29 '20 09:02 mitra42

Also note. both appear to be typos i.e. non existant items, but still shouldnt fail crawl

mitra42 avatar Feb 29 '20 09:02 mitra42