iis icon indicating copy to clipboard operation
iis copied to clipboard
verified publisher icon openaire

Consider removing fault output in cached webcrawler

Open przemyslawjacewicz opened this issue 4 years ago • 0 comments

CachedWebCrawlerJob creates output file with Faultrecords corresponding to failed content retrieval (transient and persistent). It seems that this file is not used in IIS - SoftwareExporterJob only uses document to software with source output. We should verify if the fault output is actually not used and if this will be the situation remove it completely.

przemyslawjacewicz avatar Feb 23 '21 18:02 przemyslawjacewicz