webscraping topic

List webscraping repositories

gotor

154
Stars
43
Forks
Watchers

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.

youtube-audio

69
Stars
1
Forks
Watchers

extract videos from youtube in audio format using webscraping techniques :notes:

robotstxt

69
Stars
9
Forks
Watchers

robots.txt file parsing and checking for R

newspaperjs

71
Stars
19
Forks
Watchers

News extraction and scraping. Article Parsing

This repository contains data and code used to get and clean data from https://github.com/CSSEGISandData/COVID-19 and https://www.worldometers.info/coronavirus/

Instagram-Scraper-2021

110
Stars
12
Forks
Watchers

Scrape Instagram content and stories, using a new technique based on the har file (No Token + No public API).

Catalyst

76
Stars
14
Forks
Watchers

A VS code Extension to accelerate the process of solving problems on Codeforces.

WebScrapper

107
Stars
72
Forks
Watchers

Simple and powerfull all in one Telegram Bot to scrap / crawl webpages using Requests, html5lib and Beautifulsoup

fifa-FUT-Data

74
Stars
17
Forks
Watchers

Web-scraping script that writes the data of all players from FutHead and FutBin to a CSV file or a DB