Scraping-Scripts
Scraping-Scripts copied to clipboard
thechive.com.py - Cannot find last page
The script cannot find the last page as it did previously, once started it just continues on like this:
200 @ 106000 next status should be 404, in/decrement will be 1000
200 @ 107000 next status should be 404, in/decrement will be 1000
200 @ 108000 next status should be 404, in/decrement will be 1000
200 @ 109000 next status should be 404, in/decrement will be 1000
200 @ 110000 next status should be 404, in/decrement will be 1000
200 @ 111000 next status should be 404, in/decrement will be 1000
200 @ 112000 next status should be 404, in/decrement will be 1000
I'll be sure to check it as soon as I can!
I got around this by changing the last page variable
lastPage = 1000
#lastPage = findLastPage()