distributed-spider topic
List
distributed-spider repositories
scrapy-distributed
53
Stars
11
Forks
Watchers
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
Elise
40
Stars
10
Forks
Watchers
:hand: A simple, extensible, and support for a distributed crawler framework.一个简单的，高度可扩展的，并且支持分布式的爬虫框架