Patrick Ocheja

Retrieve next page only if it exists

1

Fixes the problem of crawling only 2~5 pages even when more pages are requested.

Check if page response contains body, if not pass response as body to cheerio.