Jeremy Singer-Vine

Results 262 comments of Jeremy Singer-Vine

Based on the line numbers in the stack trace, my hunch is that you're on version `0.6.1` or earlier. Version `0.6.2` *should* handle that conditional more gracefully. Let me know...

Hi @justingoldberg, and thanks for the note. As it's currently written, this library's code is quite specific to the Wayback Machine, and I don't personally see having time to support...

Hi @Derek-Jones, and thanks for the suggestion. I've now added `--delay X` (in the CLI, and `delay=X` in `download_to`), available in `v0.6.0`. This adds a pause of X seconds between...

Ah, thanks for flagging. Looks like we need to handle `ConnectTimeout` (instead of just `ConnectionError`). Attempted fix now pushed in v0.6.1.

Hi @uy5cu71, and thanks for your interest in this library. Unfortunately, I'm not sure I 100% understand your inquiry. But if it helps: `waybackpack` does not currently support the `matchType`...

Thanks! And that's a great point. I'm leaning toward shifting `waybackpack`'s away from filesystem storage and toward database storage. (Relevant comment [here](https://github.com/jsvine/waybackpack/issues/8#issuecomment-280349613).) With the latter, there would be no need...

Hi @Mennaruuk, perhaps the code in the `tests/` directory are helpful for demonstrating the usage, e.g., here: https://github.com/jsvine/waybackpack/blob/master/tests/test-download.py

Hi, you should be able to achieve one-snapshot-per-day via the `--collapse` parameter documented in `waybackpack -h`, which uses the Wayback Machine CDX Server API's ["collapse" parameter](https://github.com/internetarchive/wayback/blob/master/wayback-cdx-server/README.md#collapsing). Does that work for...

This is not currently possible with `waybackpack`. But you can get part of the way by using `waybackpack --list https://example.com | grep ".js"`, and then use `curl`/`wget` to download those...

There are probably several ways to determine this, but one is to open the PDF in a plain-text editor. At the bottom, you'll see something like this abrupt ending: (And...