scrapyd topic

Possibly the best practice of Scrapy 🕷 and renting a house 🏡

kezhenxu94

Docs and files for ScrapydWeb, Scrapyd, Scrapy, and other projects

my8100

A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.

my8100

Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO :point_right:

my8100

Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO :point_right:

my8100

豆瓣电影/豆瓣读书 Scarpy 爬虫

baabaaox

Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js

Gerapy

admin ui for scrapy/open source scrapinghub

DormyMo

Lite version of Crawlab. 轻量版 Crawlab 爬虫管理平台

crawlab-team

狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署；爬虫监控可视化; 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑

casual-silva