web-crawling topic
daenerys
Scraping and Web Crawling Framework For Zhihu Live
scrapyd-cluster-on-heroku
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO :point_right:
crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and o...
InfinityCrawler
A simple but powerful web crawler library for .NET
Bet-on-Sibyl
Machine Learning Model for Sport Predictions (Football, Basketball, Baseball, Hockey, Soccer & Tennis)
krawler
A web crawling framework written in Kotlin
scrapy-training
Scrapy Training companion code
amazon-scraper
A simple web scraper to extract Product Data and Pricing from Amazon
ayakashi
:zap: Ayakashi.io - The next generation web scraping framework
bancocentralbrasil
💵 💰 :brazil: Informações sobre taxas oficiais diárias de Inflação, Selic, Poupança, Dólar, Dólar PTAX, Euro e Euro PTAX pelo site do Banco Central do Brasil