crawling topic
List
crawling repositories
Lulu
817
Stars
140
Forks
Watchers
[Unmaintained] A simple and clean video/music/image downloader 👾
mlscraper
1.2k
Stars
84
Forks
Watchers
🤖 Scrape data from HTML websites automatically by just providing examples
socials
44
Stars
9
Forks
Watchers
👨👩👦 Social account detection and extraction in Python, e.g. for crawling/scraping.
custom-crawler
58
Stars
2
Forks
Watchers
🌌 High productivity semi-automatic crawler generator 🛠️🧰
hakrawler
4.3k
Stars
476
Forks
Watchers
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
AdminHack
637
Stars
114
Forks
Watchers
today we will hack the admin panel of the site.
stopstalk-deployment
312
Stars
96
Forks
Watchers
Stop stalking and start StopStalking :wink:
scrapy
51.2k
Stars
10.4k
Forks
1.8k
Watchers
Scrapy, a fast high-level web crawling & scraping framework for Python.
colly
22.3k
Stars
1.7k
Forks
Watchers
Elegant Scraper and Crawler Framework for Golang