ai-crawler topic

List ai-crawler repositories

Scrapegraph-ai

21.9k
Stars
1.9k
Forks
21.9k
Watchers

Python scraper based on AI

verified publisher icon ScrapeGraphAI

firecrawl

68.4k
Stars
5.3k
Forks
68.4k
Watchers

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

verified publisher icon firecrawl

ai-crawler-py

2.1k
Stars
5
Forks
2.1k
Watchers

Crawl a website starting from a URL, find relevant pages, and extract data – all guided by your natural language prompt.

verified publisher icon oxylabs

oxylabs-ai-studio-py

2.1k
Stars
13
Forks
2.1k
Watchers

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Stu...

verified publisher icon oxylabs

oxylabs-ai-studio-js

19
Stars
0
Forks
19
Watchers

Structured data gathering from any website using AI-powered scraper, crawler, and browser automation. Scraping and crawling with natural language prompts. Equip your LLM agents with fresh data. AI Stu...

verified publisher icon oxylabs