scraping-websites topic

List scraping-websites repositories

CodeChef-Gitter

25
Stars
5
Forks
Watchers

:books: Save all and update solutions submitted on Codechef to github.

ferret

5.6k
Stars
299
Forks
Watchers

Declarative web scraping

sarenka

618
Stars
88
Forks
Watchers

OSINT tool - gets data from services like shodan, censys etc. in one app

cloudflare-scrape

3.3k
Stars
453
Forks
Watchers

A Python module to bypass Cloudflare's anti-bot page.

web-scraping

310
Stars
181
Forks
Watchers

Más de 50 ejemplos de web scraping utilizando: Requests | Scrapy | Selenium | LXML | BeautifulSoup

Email-extractor

176
Stars
72
Forks
Watchers

The main functionality is to extract all the emails from one or several URLs - La funcionalidad principal es extraer todos los correos electrónicos de una o varias Url

crawly

889
Stars
108
Forks
Watchers

Crawly, a high-level web crawling & scraping framework for Elixir.

tinking

415
Stars
28
Forks
Watchers

🧶 Extract data from any website without code, just clicks.

seleniumcrawler

127
Stars
46
Forks
Watchers

An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site

Instagram-to-discord

121
Stars
62
Forks
Watchers

Monitor instagram user account and automatically post new images to discord channel via a webhook. Working 2022!