web-data topic

List web-data repositories

WarcDB

384
Stars
11
Forks
Watchers

WarcDB: Web crawl data as SQLite databases.

verified publisher icon Florents-Tselai

Scrapegraph-ai

21.9k
Stars
1.9k
Forks
21.9k
Watchers

Python scraper based on AI

verified publisher icon ScrapeGraphAI

export-safari-reading-list

18
Stars
3
Forks
Watchers

Export Safari reading list to JSON or CSV

verified publisher icon smrfeld

firecrawl

68.4k
Stars
5.3k
Forks
68.4k
Watchers

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

verified publisher icon firecrawl