Create classes for common harvest transforms: Filters, Excludes, Overrides, Defaults

[janette]

Transforms

Add common transform classes to allow user to fine tune the results of the harvest.

Filters Filters restrict the datasets imported by a particular field. For instance, if you are harvesting a data.json source and want only to harvest health-related datasets, you might add a filter with "keyword":"heatlh"

Excludes Excludes are the inverse of filters. For example, if you know there is one publisher listed on the source whose datasets you do not want to bring into your data portal, you might add "publisher.name":"Agency of Untidy Data"

Overrides Overrides will replace values from the source when you harvest. For instance, if you want to take responsibility for the datasets once harvested and add your agency's name as the publisher, you might add "publisher.name":"My agency". This would replace any existing value.

Defaults Defaults work the same as overrides, BUT will only be applied if the relevant field is empty in the source

Bonus points

Build a UI for the user to create a harvest.