scrapy topic
files
Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects
logparser
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
scrapyd-cluster-on-heroku
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO :point_right:
scrapydweb
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:
jd_spider
Two dumb distributed crawlers
GoodreadsScraper
Scrape data from Goodreads using Scrapy and Selenium :books:
ScrapyDouban
豆瓣电影/豆瓣读书 Scarpy 爬虫
Linkedin Scraper using Selenium Web Driver, Chromium headless, Docker and Scrapy
tripadvisor-scraper
TripAdvisor scraper