scraping topic
crawler-chrome-extensions
爬虫工程师常用的 Chrome 插件 | Chrome extensions used by crawler developer
html-table-to-json
Generate JSON representations of HTML tables
mtnt
Code for the collection and analysis of the MTNT dataset
pdf.tocgen
A CLI toolset to generate table of contents for PDF files automatically.
worldometer
Get live, population, geography, projected, and historical data from around the world 🌍
requests-html
Pythonic HTML Parsing for Humans™
freesoccer
:soccer: Free API with results from national soccer competitions
Humanoid
Node.js package to bypass CloudFlare's anti-bot JavaScript challenges
RARBG-scraper
With Selenium headless browsing and CAPTCHA solving
List-of-user-agents
List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)