David Underdown

Performance throttling

2

Having been thinking about the possibility of using CSV Validator with DROID reports as the basis of ongoing integrity checking of digital archive holdings (in the case where an archive...

Enhance validator output to make filtering by error type more straightforward

1

Experience of using the validator in live projects suggests that it is often useful to be able to concentrate on one error type at a time. If output was more...

When dealing with a CSV file that refers to a large quantity of data that requires checksumming that can add a very significant overhead to running CSV validation. It would...

Parsing schema before beginning data validation can take a significant length of time with complex schema, status bar should give more info on that stage

3

It can take a significant length of time (over 5 minutes) to parse complex schemas and begin actual validation. This phase may also include an initial pass through the CSV...

Processing a sample file received from a supplier, they had (probably inadvertently) included spaces at the start of a couple column names (and I wanted to try to get the...

In the case of our digitisation project, the file_path includes a zero-padded running number (aka ordinal) for the image files within a piece or item. Using concat within starts and...

In several digitisation projects we have come across the situation where it is required that there is a simple correspondence between two ranges. For example, a set of files is...

Implement digital-preservation/csv-schema#7 by adding the urlDecode feature to the CSV Validator (see #117)

Write out error reports during processing, rather than all at end

2

Presently not presented to the user until processing is entirely completed. It would be more useful if error reports were written out to the console as they are found.

Extend checksum expression to optionally produce warning or error if checksum value is for an empty message

1

The cryptographic hash functions will each produce a consistent hash value when presented with an empty file (or any empty message). This value is different for each hash function, but...