spider topic
Photon
Incredibly fast crawler designed for OSINT.
Mzitu_Spider
:truck:一只爬取mzitu.com美女图片的小爬虫，不说了赶紧上车～
v2ex-action
🔝 V2EX GitHub Action | 自动发送 V2EX 热门内容到企业微信、钉钉等，可自定义发送周期
toplog
An Aggregator for Programmers
Crawler-Detect
🕷 CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agent
XSRFProbe
The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.
WordlistSmith
A tool to quickly scrape a website and generate a wordlist. Multithreading capable.
goribot
[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
gospider
⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架
awesome-python-primer
自学入门 Python 优质中文资源索引，包含 书籍 / 文档 / 视频，适用于 爬虫 / Web / 数据分析 / 机器学习 方向