spider-framework topic
List
spider-framework repositories
goribot
210
Stars
30
Forks
Watchers
[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
gospider
203
Stars
18
Forks
Watchers
⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架
wsltools
311
Stars
31
Forks
Watchers
Web Scan Lazy Tools - Python Package
katana
10.2k
Stars
527
Forks
88
Watchers
A next-generation crawling and spidering framework.
salyut
51
Stars
12
Forks
Watchers
This is an engine of a spider markup-language which called trico. (spider framework)
gathertool
48
Stars
13
Forks
Watchers
gathertool是golang脚本化开发库，目的是提高对应场景程序开发的效率；轻量级爬虫库，接口测试&压力测试库，DB操作库等。
spiderman
18
Stars
4
Forks
Watchers
your friendly neighborhood web crawler
scrapyteer
19
Stars
0
Forks
Watchers
Web crawling & scraping framework for Node.js on top of headless Chrome browser