website-scraper topic

List website-scraper repositories

jseval

24
Stars
1
Forks
Watchers

Evaluate JavaScript on a URL through headless Chrome browser.

Email-Extractor

16
Stars
4
Forks
Watchers

A spider to crawl webpages

wbm-dl

80
Stars
16
Forks
Watchers

Wayback Machine Downloader. 🔥 Download your entire archived websites from the Internet Archive Wayback Machine.

Uscrapper

490
Stars
51
Forks
Watchers

Uscrapper Vanta: Dive deeper into the web with this powerful open-source tool. Extract valuable insights with ease and efficiency, from both surface and deep web sources. Empower your data mining and...

WebScraper

61
Stars
14
Forks
Watchers

Python-based web crawling script with randomized intervals, user-agent rotation, and proxy server IP rotation to outsmart website bots and prevent blocking.

goClone

60
Stars
2
Forks
Watchers

🌱 goClone - clone websites in seconds

marvel-snap-scrapr

21
Stars
7
Forks
Watchers

Scraper for https://marvelsnapzone.com to retrieve metadata of Marvel SNAP cards.

followers-scraper-serverless

18
Stars
2
Forks
Watchers

Now you can keep track of your followers from YouTube, Instagram and Twitter accounts - Followers scraper API on AWS serverless

linkedin-post-automator

51
Stars
15
Forks
Watchers

Automatically curates and posts content to LinkedIn. It can optionally use web scraping to gather data, which is then fed to ChatGPT to craft engaging LinkedIn posts.

scrapeGPT

67
Stars
9
Forks
Watchers

ScrapeGPT is a RAG-based Telegram bot designed to scrape and analyze websites, then answer questions based on the scraped content. The bot utilizes Retrieval Augmented Generation and webscraping to re...