spider-framework topic
goribot
[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
gospider
⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架
wsltools
Web Scan Lazy Tools - Python Package
katana
A next-generation crawling and spidering framework.
salyut
This is an engine of a spider markup-language which called trico. (spider framework)
gathertool
gathertool是golang脚本化开发库，目的是提高对应场景程序开发的效率；轻量级爬虫库，接口测试&压力测试库，DB操作库等。
spiderman
your friendly neighborhood web crawler
scrapyteer
Web crawling & scraping framework for Node.js on top of headless Chrome browser