webscraping topic

List webscraping repositories

Dorkify

194
Stars
38
Forks
Watchers

Perform Google Dork search with Dorkify

amazon_tracker

24
Stars
6
Forks
Watchers

A simple amazon tracker that sends you an email when prices of your followed products fall down!

allitebooks

5
Stars
5
Forks
Watchers

scraped www.allitebooks.com and index all the books available.

bing-ip2hosts

122
Stars
31
Forks
Watchers

bingip2hosts is a Bing.com web scraper that discovers websites by IP address

suckit

714
Stars
40
Forks
Watchers

Suck the InTernet

django-dynamic-scraper

1.1k
Stars
309
Forks
Watchers

Creating Scrapy scrapers via the Django admin interface

datadoubleconfirm

57
Stars
39
Forks
Watchers

Simple datasets and notebooks for data visualization, statistical analysis and modelling - with write-ups here: http://projectosyo.wix.com/datadoubleconfirm.

htmldate

113
Stars
27
Forks
Watchers

Fast and robust date extraction from web pages, with Python or on the command-line

dude

412
Stars
20
Forks
Watchers

dude uncomplicated data extraction: A simple framework for writing web scrapers using Python decorators

autoscraper

6.0k
Stars
632
Forks
Watchers

A Smart, Automatic, Fast and Lightweight Web Scraper for Python