web-crawler topic

Simple library which parses web pages into objects usin attributes

jasniec

Fast, highly configurable, cloud native dark web crawler.

creekorful

:notebook_with_decorative_cover: 教育部《重編國語辭典修訂本》 網路爬蟲 :: A live web crawler for the Chinese-Chinese dictionary published by the Ministry of Education in Taiwan

lnishan

Easy way to brute-force web directory.

abaykan

Opensource Korean chatbot framework

hyunwoongko

Script to fetch webcomics and use them to create ebooks.

SylvainDe

Displays all the 2019 CVPR Accepted Papers in a way that they are easy to parse.

mattdeitke

A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits.

brendonboshell

Scrape data from Goodreads using Scrapy and Selenium :books:

havanagrawal

A web crawler for Go

yields