Scrapy Plugins

Scrapy+Splash for JavaScript integration

scrapy-plugins

🎭 Playwright integration for Scrapy

scrapy-plugins

Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy

scrapy-plugins

Scrapy spider middleware to ignore requests to pages containing items seen in previous crawls

scrapy-plugins

Scrapy extension to write scraped items using Django models

scrapy-plugins

Scrapy extension to control spiders using JSON-RPC

scrapy-plugins

scrapy-plugins

Scrapy schema validation pipeline and Item builder using JSON Schema

scrapy-plugins

Scrapy middleware to add extra fields to items, like timestamp, response fields, spider attributes etc.

scrapy-plugins

A Scrapy pipeline to categorize items using MonkeyLearn

scrapy-plugins