web-scraper topic

List web-scraper repositories

Scrapegraph-ai

21.9k
Stars
1.9k
Forks
21.9k
Watchers

Python scraper based on AI

firecrawl

68.4k
Stars
5.3k
Forks
68.4k
Watchers

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

wreq-util

45
Stars
21
Forks
45
Watchers

Common utilities for wreq

Scrapling

8.2k
Stars
466
Forks
8.2k
Watchers

🕷️ An undetectable, powerful, flexible, high-performance Python library to make Web Scraping Easy and Effortless as it should be!

ai-web-scraper

56
Stars
11
Forks
56
Watchers

AI web scraper built with Crawl4AI for extracting structured leads data from websites.

Lat-Epig

18
Stars
0
Forks
18
Watchers

The Lat-Epig interface allows you to query the EDCS and save the search result in a TSV file and plot the results on a map of the Roman Empire without any prior knowledge of programming.

PosterDownloader

15
Stars
7
Forks
15
Watchers

Webscraper for downloading official movie posters in the highest resolution available

Helios

237
Stars
374
Forks
237
Watchers

Helios is an COMPLETELY UNBLOCKABLE proxy with tabs that can be static hosted, can be run locally, and is html css js only! This is (as far as i've found) the only true UNBLOCKABLE only HTML proxy tha...