web-scraper topic

List web-scraper repositories

single-file-cli

505
Stars
53
Forks
Watchers

CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on SingleFile)

quick-start-guide

539
Stars
4
Forks
Watchers

Python quick start guides to get the most out of Oxylabs' Web Scraper API free trial.

python-scrapfly

19
Stars
5
Forks
Watchers

Scrapfly Python SDK for headless browsers and proxy rotation

aiohttp_chromium

58
Stars
8
Forks
58
Watchers

aiohttp-like interface to chromium. based on selenium_driverless to bypass cloudflare

opensubtitles-scraper

20
Stars
1
Forks
Watchers

scrape subtitles from opensubtitles.org

how-to-scrape-google-scholar

108
Stars
0
Forks
Watchers

A guide for extracting titles, authors, and citations from Google Scholar using Python and Oxylabs SERP Scraper API.

RAVAGE

16
Stars
4
Forks
Watchers

A Linux shell tool that has multiple tools such as, Instagram Scraper, Phisher, Network Scanner, Port Scanner, Packet Sniffer, Web Scraper, Wifi Flooder

telegram-scraper

31
Stars
10
Forks
31
Watchers

A simple Telegram channel scraper

maxun

12.1k
Stars
932
Forks
Watchers

🔥 Open Source No Code Web Data Extraction Platform. Turn Websites To APIs & Spreadsheets With No-Code Robots In Minutes 🔥

CyberScraper-2077

1.9k
Stars
177
Forks
1.9k
Watchers

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama