crawl4ai topic

List crawl4ai repositories

crawlwithagents

18
Stars
8
Forks
18
Watchers

The Web Metadata Extraction Toolkit is designed to streamline the process of extracting, cleaning, and analyzing metadata from websites. Utilizing advanced AI models and custom extraction strategies,...

WaterCrawl

1.5k
Stars
163
Forks
1.5k
Watchers

Transform Web Content into LLM-Ready Data

ai-web-scraper

56
Stars
11
Forks
56
Watchers

AI web scraper built with Crawl4AI for extracting structured leads data from websites.

supa-crawl-chat

27
Stars
5
Forks
27
Watchers

Integrates Supabase with Crawl4AI and AI Chat to create a powerful web crawling and semantic search solution. Streamlit supabase data visualization. Run all in Docker. API and more!