Ed Summers

Stanford Only 3D items aren't viewable

3

Currently it's not possible to view Stanford Only 3D objects in SearchWorks and PURL. There are [39 items](https://argo.stanford.edu/catalog?f%5Bcontent_type_ssim%5D%5B%5D=3d&f%5Brights_descriptions_ssim%5D%5B%5D=stanford), for example: https://purl.stanford.edu/bx715my3000  The reason...

Adding support for HTTP Basic Auth

3

You can use the `--httpBasicAuth` flag to pass colon separated username and password credentials to the browser used for crawling. For some reason I couldn't get `page.authenticate()` to work as...

Unable to resume crawl: not valid JSON

2

When resuming a crawl I noticed that passing `--url` seemed necessary, which seemed counter intuitve. Once I did this however I got a JSON parse error? ``` docker run -v...

It's probably worth reminding people that the command line options need to be passed in again since the crawl state doesn't include them. Refs #568

I've seen this a couple times witb v1.1.1 and thought it might be worth noting down. It doesn't seem to be easily reproducible unfortunately: ``` Error: INTERNAL ERROR: missing context...

CDXJ: Error: no such capture field: method

7

When posting a CDXJ file (generated with pywb 2.6.7) to the [OutbackCDX on DockerHub](https://hub.docker.com/r/nlagovau/outbackcdx) (v0.11.0?) like so curl -X POST --data-binary @index.cdxj http://localhost:8080/coll I'm seeing the following error get printed...

Use extracted text in WARC resource records

2

Thanks for this elegant example of how to do RAG with WARC data! I also very much appreciated how the [blog post](https://lil.law.harvard.edu/blog/2024/02/12/warc-gpt-an-open-source-tool-for-exploring-web-archives-with-ai/) highlighted limitations with citation (which is important for...

### What change would you like to see? I would like to be able to toggle on/off crawler behaviors when doing a crawl so that I can modify what gets...

Implement "smart suggest" using the Solr select endpoint rather than suggest in order to get the document IDs for the title results, so they can be directly linked to. When...

This PR adjusts the auto suggestions to provide three categories of results: locations, datasets and maps. It updates the suggest endpoint to draw from two suggestion dictionaries. closes #1047