scraping topic

List scraping repositories

linkedin-profile-scraper-api

492
Stars
140
Forks
Watchers

🕵️‍♂️ LinkedIn profile scraper returning structured profile data in JSON.

mechaml

89
Stars
6
Forks
Watchers

OCaml functional web scraping library

django-dynamic-scraper

1.1k
Stars
309
Forks
Watchers

Creating Scrapy scrapers via the Django admin interface

docker-selenium-lambda

465
Stars
113
Forks
Watchers

The simplest demo of chrome automation by python and selenium in AWS Lambda

m2m

30
Stars
3
Forks
Watchers

Transform a Medium post into a Markdown file

awesome-puppeteer

2.3k
Stars
156
Forks
Watchers

A curated list of awesome puppeteer resources.

Embed

2.1k
Stars
308
Forks
Watchers

Get info from any web service or page

node-red-contrib-nbrowser

33
Stars
13
Forks
Watchers

Provides a virtual web browser (a.k.a. "headless browser") appearing as a node.

daenerys

63
Stars
30
Forks
Watchers

Scraping and Web Crawling Framework For Zhihu Live

snoop

2.7k
Stars
325
Forks
Watchers

Snoop — инструмент разведки на основе открытых данных (OSINT world)