data-scraping topic

List data-scraping repositories

reaper

357
Stars
70
Forks
Watchers

Social media scraping / data collection tool for the Facebook, Twitter, Reddit, YouTube, Pinterest, and Tumblr APIs

web-scraping

689
Stars
164
Forks
Watchers

Detailed web scraping tutorials for dummies with financial data crawlers on Reddit WallStreetBets, CME (both options and futures), US Treasury, CFTC, LME, MacroTrends, SHFE and alternative data crawle...

stockeye

158
Stars
34
Forks
Watchers

Keep track of short term stock movement by monitoring breaking news activity

upgini

295
Stars
25
Forks
Watchers

Data search & enrichment library for Machine Learning → Easily find and add relevant features to your ML & AI pipeline from hundreds of public and premium external data sources, including open & comme...

Scraping-Youtube-Comments

67
Stars
24
Forks
Watchers

Scrape comments from any Youtube video

Analysing-Glassdoor-Jobs

41
Stars
11
Forks
Watchers

Data Analysis of Job Postings on Glassdoor.

GitHub-User-Insights-using-API

42
Stars
31
Forks
Watchers

The project involves using the GitHub API using user authentication to fetch information such as commits and repositories for that specific user and store them as CSV files for data collection and ana...

cbse_schools_data

46
Stars
20
Forks
Watchers

Cleaned, scraped data of all 20,367 CBSE schools, primarily in India, in 2018. Data scraped from: cbseaff.nic.in/cbse_aff/schdir_Report/userview.aspx

spotify-analysis

25
Stars
3
Forks
Watchers

Data analysis on my monthly playlists

e-commerce-web-scraper

50
Stars
12
Forks
Watchers

Scraping details of products from ecommerce websites using python