webcrawling topic
fifa-FUT-Data
Web-scraping script that writes the data of all players from FutHead and FutBin to a CSV file or a DB
ARGUS
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks...
malheatmap
An extension for tracking your activities on myanimelist.net
ioweb
Web Scraping Framework
Stock-Fundamental-data-scraping-and-analysis
Project on building a web crawler to collect the fundamentals of the stock and review their performance in one go
courlan
Clean, filter and sample URLs to optimize data collection – includes spam, content type and language filters
inparse
Open Collaborative AI Driven Parser builder for Web Scraping, Data Extraction and Crawling,Knowledge Graph
tibia.py
API to parse tibia.com content into python objects.
url-frontier
API definition, resources and reference implementation of URL Frontiers
proxy_web_crawler
Automates the process of repeatedly searching for a website via scraped proxy IP and search keywords