Proxy Scraper

From URL List

🚀 Crawl free Proxies from list of URLs 🚀

🏗 Use for your own Projects or Modify if needed 🏗

📌 Ver. 1.0 📌

🤖 Full Proxy Scraper 🤖

Features

• Scrape proxies from HTML code from URLs
• Save scraped proxies to seperate text file
• Check all scraped proxies on definded url
• Save checked and working proxies into seperate text file

Getting Started

This script can Scrape free Proxies of the Internet.

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.

Support 👨‍💻

Any problems with running the script and any questions please cantact me via Twitter @hendrik_bgr

Prerequisites

• Python 3.6+

Before We get started

Let's Get Started:

Get a copy of the Project. Open your Terminal and enter:

git clone https://github.com/hendrikbgr/Proxy-Scraper

(Work in progress) To install all needed requirements run the following command in the project directory:

pip install -r requirements.txt

After that you can proceed to start the Script.

Running 🏃🏽‍♂️

To run this script open your Terminal in the project directory.

To start the Account Creator Script enter:

python3 main.py

Output

You will find all scraped proxies in:

proxies.txt

You will find all checked & working proxies in:

checked.txt

How To Run on Windows 10 ( total beginners guide )

Made by @byomartin

• Open Start and search for Microsoft Store
• Find "python" and install Python 3.10
• Download proxy scraper source code and unzip to any folder
• Open source folder, on the file explorer address bar now type "cmd" to open command line terminal
• Now type "pip install requests-html" to install requests-html module
• Type "pip install aiohttp" to install aiohttp module
• Now type "python3 main.py" the program will start
• Wait till it finishes you will get fresh working proxies

Authors

• Hendrik Bgr - Initial work - HendrikBgr

Acknowledgments

• Hat tip to anyone whose code was used
• Thanks to @byomartin for creating the beginners guide

Notes

This code is for educational use only.