Tony Wang

Results 4 repositories owned by Tony Wang

scaleable-crawler-with-docker-cluster

96
Stars
27
Forks
Watchers

a scaleable and efficient crawelr with docker cluster , crawl million pages in 2 hours with a single machine

Build Docker clusters with Celery and RabbitMQ in 10 minutes

Introduction to Algorithms, 3rd Edition python code

distributed-web-crawler

44
Stars
5
Forks
Watchers

The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler