web-scraping topic

List web-scraping repositories

PHPScraper

497
Stars
73
Forks
Watchers

A universal web-util for PHP.

codepen-puppeteer

22
Stars
13
Forks
Watchers

Use Puppeteer to download pens from Codepen.io as single html pages

ChiChew

25
Stars
7
Forks
Watchers

:notebook_with_decorative_cover: 教育部《重編國語辭典修訂本》 網路爬蟲 :: A live web crawler for the Chinese-Chinese dictionary published by the Ministry of Education in Taiwan

GSoC-Data-Analyser

29
Stars
3
Forks
Watchers

Simple search for organisations participating/participated in the GSoC

IMDB-Scraper

50
Stars
12
Forks
Watchers

Scrapy project for scraping data from IMDB with Movie Dataset including 58,623 movies' data.

selectolax

978
Stars
62
Forks
Watchers

Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).

pastebin-bisque

23
Stars
5
Forks
Watchers

Download all of a given user's public Pastebin pastes

awesome-web-scraping

6.4k
Stars
772
Forks
Watchers

List of libraries, tools and APIs for web scraping and data processing.

animeX-v2

68
Stars
17
Forks
Watchers

animeX is a CLI tool for downloading anime directly to your PC

apple-autofill-domains

62
Stars
2
Forks
Watchers

Apple's allowed autofill domains