heritrix3 icon indicating copy to clipboard operation
heritrix3 copied to clipboard
verified publisher icon internetarchive

fetchDNS lacks timeout option

Open renevoorburg opened this issue 7 years ago • 0 comments

Running a recent 3.3.0 snapshot, a harvest remains in the RUNNING state with 4 requests queued. These 4 requests relate to 2 domains. For each domain the dns request 'hangs'. Indeed, an nslookup requests for the given domains replies "*** Can't find firebaseio.com: No answer" So it appears that Heritrix needs to be able to timeout DNS requests.

renevoorburg avatar Jan 25 '18 14:01 renevoorburg