proxy-scraper
proxy-scraper copied to clipboard
iw4p
Sources
Hii there I used this scraper and it was good but it will be more better if you please provide option to manually add sources for proxies. Like different sources files http,socks4,socks5 so that we can have more proxies from our own desired url/website. Please look into this.
Hi It's a scraper, which is designed for specific websites. So it can not scrape every proxy website until I implement it because each site has different tags. You can give me websites and I'll add them.
why don't you add a regex for ip:port instead, saves you the trouble.
Because I'm not just good at regex, :D kidding, but having a well-structured scraper is better than just using regex in my prospective. Regex is my last solution always. Do you think regex is a better option?
Well, sure why not? it can barely mess with your well structured code as it only consists of 5-6 lines of extra code (for simpler terms), without requiring any fancy structuring to the code.
It can be a good solution, but I have to test it. If you have time you can do a sample on your fork maybe? And we can check the time for doing benchmarks.