ai-scraping topic

List ai-scraping repositories

spider

708
Stars
71
Forks
Watchers

The fastest web crawler written in Rust. Maintained by @a11ywatch.

firecrawl

26.4k
Stars
2.2k
Forks
144
Watchers

🔥 Turn entire websites into LLM-ready markdown or structured data. Scrape, crawl and extract with a single API.

firecrawl-app-examples

24
Stars
7
Forks
Watchers

🔥 This repository contains complete application examples, including websites and other projects, developed using Firecrawl.