Ed Summers

Fetch errors on console

1

I noticed that there are a lot of fetch errors on the console when opening the ArchiveWebPage extension (v0.10.0). It's not clear to me if they are causing problems or...

I think I've noticed a degradation in the archiving of Instagram. I created a snapshot for https://www.instagram.com/nasagoddard/ using the latest ArchiveWebPage (v0.8.3) on autopilot. I could see that individual posts...

Screencasts with multiple workers eventually fail

6

I noticed that screencasts eventually fail when running with [this configuration](https://gist.github.com/edsu/290787aa69f3cc4a4d9201d77aec212b) for archiving a set of page URLs with four workers with screencasting turned on for port 9037: ``` docker...

When crawling https://library.stanford.edu/blogs/special-collections-unbound/2022/11/born-digital-collections-opened-research-2022 with browsertrix-crawler v0.10.0 I noticed that some resources (e.g. https://purl.stanford.edu/pq546tq4448/iiif/manifest) were not being captured because the page was not being autoscrolled. Here is the configuration I used...

I noticed that browsertrix-crawler writes a WACZ `datapackage.json` with ```json "software": "py-wacz 0.4.7" ``` I think this is because py-wacz is being used to package up everything once the crawl...

CAS Authentication?

7

This question might be wrongheaded as I am brand new to Polis. A group of students at my university is considering bringing up an instance of Polis to help in...

Hijacked Twitter Handles

1

If an agency registers a Twitter account and then decides to change their handle the registry should notice and update the listed handle. If this checking isn't performed then other...

Where is the 1.0 spec?

10

Congrats on [RFC 8493](https://tools.ietf.org/html/rfc8493)! Is the plan to put the lastest spec test in this repository or over at https://github.com/libraryofcongress/bagit-spec ?

Unicode Normalization?

4

The BagIt specification lets you specify that UTF-8 encoding be used in tag manifests. But it doesn't appear to assume a [particular normalization form](https://en.wikipedia.org/wiki/Unicode_equivalence). I have [a problem](https://github.com/LibraryOfCongress/bagit-python/issues/51) where files...