lightcrawler
lightcrawler copied to clipboard
github
Crawl a website and run it through Google lighthouse
It seems to install fine, but. $ npm install lightcrawler + [email protected] updated 1 package and audited 789 packages in 2.884s found 0 vulnerabilities $ lightcrawler --url https://atom.io/ --config lightcrawler-config.json...
I have created a test project, but it occured an error when trying to run Error: spawn UNKNOWN at exports._errnoException (util.js:1020:11) at ChildProcess.spawn (internal/child_process.js:328:11) at Object.exports.spawn (child_process.js:369:9) .... Any ideas?
Lighthouse has an --extra-headers cli flag that allows us to pass in additional header e.g. Cookies with each request. Is there a way of doing this with lightcrawler? I have...
Web apps often have a large chunk of their functionality hidden beyond a login screen. It'd be cool if there was a way to fill in these credentials while crawling...
