node-scraper
node-scraper copied to clipboard
trying to fetch ñ.ñ
i used an array of urls to scrape, the number of urls i need to fetch are around 7500 urls ñ.ñ, i begin scraping and everything goes fine until the first 120 urls fetched, it starts going slooooooow... more and more, until it crashes and cannot fetch another one anymore, does the library supports heavy scraping i need to scrape tons of things :(