scraperjs
scraperjs copied to clipboard
Character encoding - possible to set it?
I'm trying to parse a website however the characters are read wrong, probably due to the character setting. Is there any way this can be set?
Yes, scraperjs
uses request, you should refer back to it.
Instead of a string for the url:
scraperjs.StaticScraper.create('http://www.somesite.com').scrape(...)
Use an object with the parameters url and encoding, like this:
scraperjs.StaticScraper.create({ url: 'http://www.somesite.com', encoding: "binary" }).scrape(...)