Scrapy project

Results 20 repositories owned by Scrapy project

slybot

224
Stars
61
Forks
Watchers

w3lib

378
Stars
107
Forks
Watchers

Python library of web-related functions

booksbot

38
Stars
889
Forks
Watchers

A crawler for http://books.toscrape.com

itemadapter

60
Stars
13
Forks
Watchers

Common interface for data container classes

itemloaders

41
Stars
14
Forks
Watchers

Library to populate items using XPath and CSS with a convenient API

protego

51
Stars
26
Forks
Watchers

A pure-Python robots.txt parser with support for modern conventions.

scrapy-bench

30
Stars
15
Forks
Watchers

A CLI for benchmarking Scrapy.

scrapy.org

58
Stars
140
Forks
Watchers

The scrapy.org website

scurl

21
Stars
6
Forks
Watchers

Performance-focused replacement for Python urllib

pypydispatcher

15
Stars
4
Forks
Watchers

A fork of http://pydispatcher.sourceforge.net/ with PyPy support