node-metainspector
node-metainspector copied to clipboard
Node npm for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, an array with all the links, all the images in it, etc. Inspired by the metainsp...
It would be good if the README could include what the default options are.
Related to #28
When provided a URI that is not a valid text/html document, passing the data into cheerio can result in a call stack overflow. This modification performs a HEAD request first...
I don't know if all big files, or only specific ones, but this: ``` var mi = require('node-metainspector'); new mi("http://media.giphy.com/media/euBj15T6nrp6g/giphy.gif", {}).fetch(); ``` Crashes the application with: ``` node_modules/node-metainspector/node_modules/cheerio/lib/parse.js:47 _.each(dom, function(elem)...
Can not pass result async when using koa. [co-event](https://github.com/segmentio/co-event) can capture the event value via emit as sync. Returns events in sequence, with the `.type` and `.args` keys. ``` js...
Thanks for the library, very handy! Any plans to add support for `og:video` tags?
Good day I am having a problem The plugin works fine when the url is entered from another accessible page hits http, url But when he is sent to a...
I am trying to log out the images on a webpage and it does not work. I have tried. ``` coffee console.log 'client image ' + client.images() // Crashes server...