shot-scraper
shot-scraper copied to clipboard
simonw
A command-line utility for taking automated screenshots of websites
It would help with debugging to see the browser window while shot-scraper is working, and perhaps keep it open when an error occurs (or a screenshot is taken). This would...
I found myself wanting to use [the Readability trick](https://shot-scraper.datasette.io/en/stable/javascript.html#example-extracting-page-content-with-readability-js) against multiple URLs, without having to pay the startup cost of launching a new Chromium instance for each one. Idea: a...
Init scripts are special JavaScript that gets run to prime the page before the URL is loaded: https://playwright.dev/python/docs/api/class-page#page-add-init-script > Adds a script which would be evaluated in one of the...
Playwright has support for [HAR files](https://en.wikipedia.org/wiki/HAR_(file_format)), which saves all network requests during a session to a custom file format. The API is awkward but we can use [`route_from_har`](https://playwright.dev/python/docs/api/class-page#page-route-from-har). We'll need...
Hi, I am trying to write use shot-scraper for writing some test cases to see if adult sites are blocked / open on my network. shot-scraper http://blockeddomain.com --log-requests - raise...
Hi, thank you for this great tool. If I run ``` shot-scraper https://elezioni.interno.gov.it/europee/scrutini/20240609/scrutiniEI5190550010 ``` I have a png with 403 error. If I browse the page with a browser I...
How to allow insecure HTTPS connection with broken certs? Like `single-file --browser-ignore-insecure-certs ...` ?
I tried this: ```bash # Different browsers echo ' User Agent Your User Agent: document.getElementById("ua").textContent = navigator.userAgent; ' > user-agent.html shot-scraper user-agent.html \ -o examples/useragent-default-chromium.png -h 400 -w 800 shot-scraper...
He @simonw , thanks for designing great tool! I wanted to ask if you might have any suggestions on the best way to automate taking a serial (and separate) screenshots...
