datapusher-plus icon indicating copy to clipboard operation
datapusher-plus copied to clipboard

TWDH-specific: metadata fields blanked out when running 'datapusher resubmit'

Open twdbben opened this issue 1 year ago • 4 comments

Describe the bug

In the specific context of the Texas Water Data Hub schema, we run the datapusher resubmit command nightly to update resources using the following command:

ckan -c /etc/ckan/default/ckan.ini datapusher resubmit --yes

When we run this command, the 'primary_tags' and 'secondary_tags' scheming-based metadata fields on the datasets that it operates on are always blanked out when the operation completes.

To reproduce this bug, in the TWDH environment, first make sure the tag fields are set on a given dataset, then view the dataset via the API, for instance:

https://txwaterdatahub.org/api/3/action/package_show?id=surface-water-rights-water-use

Then, run the resubmit command listed above.

Wait a few seconds after the command completes - the tag-blanking does tend to lag a few seconds for some reason - and re-request the dataset from the API. Notice that the 'primary_tags' and 'secondary_tags' fields will now be empty.

twdbben avatar Jun 26 '23 20:06 twdbben