node-scraper

node-scraper copied to clipboard

How Do You Use This?

1

Do you have to create a HTML page in order for these scripts to function. What is the process that you have to take in order to use this module?...

codedcontainer

This fixes the failure due to change in jsdom API. Also, it removes the `` tags getting replaced by `` for better handling by jQuery

gargsms

My application is using scraper as an dependency and it was running fine with Node.js 10.2x versions. Now I have upgraded to Node.js 0.12 version. I ran into the following...

smartmouse

First example updated (then old one was broken)

1

The Twitter example does not seem to work anymore, probably due to changes in twitter.com. I'm proposing different example code that fetches the names of the biggest Wikipedia language sites.

tuomassalo

Pass request_options to the callback (Fixes #13)

2

Utilizes the third argument of the callback to pass back the request options for the given URL. Assists handling with parallel requests.

wilr

artem-azarov

This fixes the reference to jQuery as described in #4, updating to jQuery 1.10.2. The attempt to load the local dependency was resulting in `$` being `undefined`. It also removes...

neverfox

Running examples on current (master) version yields: ``` $ curl http://search.twitter.com/search?q=javascript The Twitter REST API v1 is no longer active. Please migrate to API v1.1. https://dev.twitter.com/docs/api/1.1/overview ``` Therefore I updated...

pawelrychlik

The following code in your project does not work on a Windows Node.js environment: ``` javascript jsdom.jQueryify(window, __dirname + '/../deps/jquery-1.6.1.min.js'), function (win, $) { $('head').append($(body).find('head').html()); $('body').append($(body).find('body').html()); callback(null, $); }); ```...

iampatgrady

i used an array of urls to scrape, the number of urls i need to fetch are around 7500 urls ñ.ñ, i begin scraping and everything goes fine until the...

jcarlos7121