web-spider topic

Tool made to automate tasks of pentesting.

Andromeda1957

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

ssssssss-team

简单易用的Python爬虫框架，QQ交流群：597510560

xianhu

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.

postmodern

ACHE is a web crawler for domain-specific search.

VIDA-NYU

The simple, easy to use command line web crawler.

rivermont

Antch, a fast, powerful and extensible web crawling & scraping framework for Go

antchfx

A simple distributed crawler for zhihu && data analysis

elliotxx

Ignareo the Carillon, a web crawler/spider template of ultimate high concurrency built for leprechauns. Carillons as the best web spiders; Long live the golden years of leprechauns! (ISML=internationa...

Hecate2

天眼查爬虫&企查查爬虫，指定关键字爬取公司信息

bouxin