scraping-framework topic

List of libraries, tools and APIs for web scraping and data processing.

lorien

a reliable high-level web crawling & scraping framework for Node.js.

zhuyingda

Lightweight web scraping toolkit for documents and structured data.

alephdata

Serritor is an open source web crawler framework built upon Selenium and written in Java. It can be used to crawl dynamic web pages that require JavaScript to render data.

peterbencze

Pythonic HTML Parsing for Humans™

kennethreitz

ProxyCrawl PHP library for scraping and crawling websites

crawlbase

Sneakpeek is a framework that helps to quickly and conviniently develop scrapers. It’s the best choice for scrapers that have some specific complex scraping logic that needs to be run on a constant ba...

flulemon

The All in One Framework to build Awesome Scrapers.

omkarcloud

An API wrapper for Scrappey.com written in Python (cloudflare, datadome bypass & solver)

pim97