scrapyd topic

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner

aaldaber

ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks...

datawizard1337

Library designed to replace the SQLite backend by a MongoDB backend on Scrapy queue management

Tiago-Lira

admin ui for scrapy/open source scrapinghub

fliot

爬虫管理平台

ToonoW

🕷️ Scrapyd is an application for deploying and running Scrapy spiders.

EasyPi

A django admin site for scrapy

liangWenPeng

Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the box.

ScrapeOps

Implement scrapy with asyncio

ConlinH

estela, an elastic web scraping cluster 🕸

bitmakerla