django-dynamic-scraper icon indicating copy to clipboard operation
django-dynamic-scraper copied to clipboard

added ProcessBasedUtils to run spiders in-process

Open scott-coates opened this issue 11 years ago • 0 comments

I was looking for a way to run the spiders in-processes and avoid scrapyd altogether. I looked online and found a way to do it. If this is something you think is a good idea, I'll be happy to provide more docs.

scott-coates avatar Jul 27 '13 02:07 scott-coates