spidermon icon indicating copy to clipboard operation
spidermon copied to clipboard

Published 20 hours ago • verified publisher icon scrapinghub

Can Spidermon monitor on database instead of scraped data

Open vionemc opened this issue 5 years ago • 2 comments

Is it solely to monitor data and pattern after scraping, or can we monitor the database condition?

vionemc avatar May 14 '19 06:05 vionemc

I think it would be great to have a solution to analyze the data generated by a spider after it has been generated, but I’m not sure this is within the scope of Spidermon.

Gallaecio avatar May 14 '19 07:05 Gallaecio

@vionemc Do you have a particular example? Do you mean monitor the scraped data being exported to a database?

manycoding avatar Jun 05 '19 00:06 manycoding