web-scraper topic

List web-scraper repositories

stealth

1.0k
Stars
288
Forks
Watchers

:rocket: Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy

php-curl-class

3.2k
Stars
825
Forks
Watchers

PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs

onlyfans-dl

764
Stars
218
Forks
Watchers

OnlyFans content downloader

html-metadata

138
Stars
43
Forks
Watchers

MetaData html scraper and parser for Node.js (supports Promises and callback style)

web-scraping

689
Stars
164
Forks
Watchers

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawle...

spidr

794
Stars
111
Forks
Watchers

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

soup

2.1k
Stars
169
Forks
Watchers

Web Scraper in Go, similar to BeautifulSoup

lightnovel-crawler

1.3k
Stars
247
Forks
Watchers

Generate and download e-books from online sources.

monkey-dl

810
Stars
70
Forks
Watchers

Bulk download your favourite anime episodes from your favourite anime websites

scrapers

569
Stars
92
Forks
Watchers

A list of scrapers from around the web.