datapusher-plus
datapusher-plus copied to clipboard
TWDH-specific: metadata fields blanked out when running 'datapusher resubmit'
Describe the bug
In the specific context of the Texas Water Data Hub schema, we run the datapusher resubmit command nightly to update resources using the following command:
ckan -c /etc/ckan/default/ckan.ini datapusher resubmit --yes
When we run this command, the 'primary_tags' and 'secondary_tags' scheming-based metadata fields on the datasets that it operates on are always blanked out when the operation completes.
To reproduce this bug, in the TWDH environment, first make sure the tag fields are set on a given dataset, then view the dataset via the API, for instance:
https://txwaterdatahub.org/api/3/action/package_show?id=surface-water-rights-water-use
Then, run the resubmit command listed above.
Wait a few seconds after the command completes - the tag-blanking does tend to lag a few seconds for some reason - and re-request the dataset from the API. Notice that the 'primary_tags' and 'secondary_tags' fields will now be empty.