Scrapy project

Results 20 repositories owned by Scrapy project

scrapy

51.3k
Stars
10.4k
Forks
1.8k
Watchers

Scrapy, a fast high-level web crawling & scraping framework for Python.

parsel

1.1k
Stars
133
Forks
Watchers

Parsel lets you extract data from XML/HTML documents using XPath or CSS selectors

queuelib

261
Stars
53
Forks
Watchers

Collection of persistent (disk-based) and non-persistent (memory-based) queues for Python

cssselect

284
Stars
60
Forks
Watchers

CSS Selectors for Python

dirbot

1.6k
Stars
1.1k
Forks
Watchers

Scrapy project to scrape public web directories (educational) [DEPRECATED]

loginform

264
Stars
78
Forks
Watchers

Fill HTML login forms automatically

quotesbot

1.3k
Stars
758
Forks
Watchers

This is a sample Scrapy project for educational purposes

scrapely

1.8k
Stars
315
Forks
Watchers

A pure-python HTML screen-scraping library

scrapyd

2.8k
Stars
566
Forks
Watchers

A service daemon to run Scrapy spiders

scrapyd-client

746
Stars
146
Forks
Watchers

Command line client for Scrapyd server