nodejs-datamining-examples

Series of examples using Node.JS to scrape websites; currently the examples include:

• Logging links on the reddit front page to console

• Logging links on the reddit front page to a csv file

• Grabbing top 100 search results from google to 10 seperate csv files (One per page)

• Grabbing top 100 search results from google to a single csv files ordered by rank

Prerequisites

FS (npm install fs)

request (npm install request)

cheerio (npm install cheerio)

Folders

node-modules - Contains the CSV module (Simple csv file writer I wrote to assist in a number of the examples)

nodes - Examples themselves