Francesco Frassinelli
Francesco Frassinelli
It seems to return a gzip file containing an HTML response "Resource not found".
It looks for an `url` in the JSON file, which is not there, as `ckanapi dumps datasets` creates resources like this: ``` { "description": "Coordinates of all sites included in...
In addition to making dump compatible with loads, a suggestion could be to raise a warning or an error when accessing a resource with an HTTP error.
`ckanapi load datasets` fails even when using `ckanapi action ckan_package_search` output, because it cannot get private datasets. CKAN returns a 404, potentially gzipped, which then gets uploaded as resource.
ckanext-scheming does not suffer of the same issue: https://github.com/ckan/ckanext-scheming/blob/a5b5522302a3cabb94f5bdb1a30a3bb7a5133403/setup.py#L27-L33
It looks interesting, but test are failing
Is it something that can be rebased/reworked?
dump is different from package_search, as dump can download resources too.
Shouldn't there be a lock mechanism to avoid running the harvesting while another one is running?
Any suggestion/example on how to handle these conditionals properly?