Kathryn Newbould

Full URL in WORKER log

1

Background: When crawling a website, it is not uncommon to see output like ``` #0 WORK http://resource.history.org.ua/cgi-bin/eiu/history.exe?&I21DBN=EJRN #1 WORK http://resource.history.org.ua/cgi-bin/eiu/history.exe?&I21DBN=EJRN #2 WORK http://resource.history.org.ua/cgi-bin/eiu/history.exe?&I21DBN=EJRN #3 WORK http://resource.history.org.ua/cgi-bin/eiu/history.exe?&I21DBN=EJRN #4 WORK http://resource.history.org.ua/cgi-bin/eiu/history.exe?&I21DBN=EJRN ```...

Background: I want to run a chunk of URLs through browsertrix while I sleep but don't want to get hacked. I also don't particularly want to check each and every...