Tor_Crawler icon indicating copy to clipboard operation
Tor_Crawler copied to clipboard

Web crawling with IP rotation via Tor

Results 4 Tor_Crawler issues
Sort by recently updated
recently updated
newest added

- Added the onion service domain parsing function - Added requirements.txt - Added examples(Web Directory Crawler)

Could you provide a license for this project?

I ask because I tried a similar approach and I had problems with Socks connection on many threads.

![image](https://user-images.githubusercontent.com/7473349/34321378-be42dc6c-e82f-11e7-9592-3aefd754782f.png) While lurking around with code, Tor is stoping the crawler by showing up captcha question. Has anyone figured out a solution from getting around the captcha?