Marius Elsfjordstrand Beck

## Describe the bug In https://github.com/webrecorder/pywb/blob/42445562dab4cfe68cabc82ee94d51e3c70ee037/docs/manual/warcserver.rst?plain=1#L216 and https://github.com/webrecorder/pywb/blob/42445562dab4cfe68cabc82ee94d51e3c70ee037/docs/manual/warcserver.rst?plain=1#L247 the syntax should be `ia: cdx+http://web.archive.org/cdx /web`, i.e. space delimiter and not semicolon. The sauce is found here: https://github.com/webrecorder/pywb/blob/42445562dab4cfe68cabc82ee94d51e3c70ee037/pywb/warcserver/index/indexsource.py#L187 ## Steps to...

Outdated JWAT version in WARC module

11

## Dev Effort 3D ## Description Current version is 1.0.3 https://github.com/openpreserve/jhove/blob/2e9444442cdaad7f749daa2db8538310ca1cc16f/jhove-ext-modules/pom.xml#L15 The most recent version in Maven repository is 1.1.1: https://mvnrepository.com/artifact/org.jwat/jwat-warc Version 1.0.6 fixed a critical error: [Payload digest should...

feat: WARC record iterator

1

The [gowarc.WarcFileReader](https://pkg.go.dev/github.com/nlnwa/gowarc#WarcFileReader) does not provide a simple way to get the size of the next record. This PR introduces an iterator abstraction for iterating over WARC records. In addition to...

refactor: limit the use of viper in packages outside cmd

1

Using viper outside command initialization and configuration makes it difficult to see what options gets applied. This commit refactors the initialization of the Filter struct in the filter package to...

Handle as many formats as possible when parsing dates

3

Based on real world testing on data from the early 2000's we need to replace the following code https://github.com/nlnwa/warchaeology/blob/ab32b5f0340bc6b44ded32960c8fe1dbbcefe29c/nedlibreader/nedlibreader.go#L58-L66 with a function that can parse as many date formats as...

Test possible close before use regression

2

Commit https://github.com/nlnwa/warchaeology/commit/a72acd4d469cb612f24e37c1b75af6553fb7ee7e possibly introduced a close before use issue (maybe nil pointer exception).

https://github.com/nlnwa/warchaeology/blob/606d0dcc55be3134b6c819c1ba87907a37a71264/main.go#L33 This setting should be localized to the cases where badger is used as it is badger who recommends the value to be 128 or higher (see https://dgraph.io/docs/badger/get-started/ and https://dgraph.io/docs/badger/faq/#are-there-any-go-specific-settings-that-i-should-use).