ai-scraping topic

List ai-scraping repositories

spider

708
Stars
71
Forks
Watchers

The fastest web crawler written in Rust. Maintained by @a11ywatch.

firecrawl

53.1k
Stars
4.6k
Forks
235
Watchers

The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data 🔥

firecrawl-app-examples

24
Stars
7
Forks
Watchers

🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.

CyberScraper-2077

1.8k
Stars
162
Forks
Watchers

A Powerful web scraper powered by LLM | OpenAI, Gemini & Ollama