crawling topic

Lightweight web scraping toolkit for documents and structured data.

alephdata

Download a large list of files concurrently

dimkouv

An Instagram bot developed using the Selenium Framework

mustafadalga

Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.

A3h1nt

Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head

N0taN3rd

Crawler for linguistic corpora

google

Scraply a simple dom scraper to fetch information from any html based website

alash3al

DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like Web...

mehmetozkaya

Laravel adapter for Roach, the complete web scraping toolkit for PHP.

roach-php

Go process used to crawl websites

trandoshan-io