js-crawler

js-crawler copied to clipboard

for example: ``` crawler.crawl({ url: "http://localhost:8080/locations/", selector: ".main-content" ``` would only follow the links found inside `.main-content` this way i don't have to keep crawling the header, footer, sidebars, etc...

duggi