Francesco Frassinelli

Results 309 comments of Francesco Frassinelli

It seems to return a gzip file containing an HTML response "Resource not found".

It looks for an `url` in the JSON file, which is not there, as `ckanapi dumps datasets` creates resources like this: ``` { "description": "Coordinates of all sites included in...

In addition to making dump compatible with loads, a suggestion could be to raise a warning or an error when accessing a resource with an HTTP error.

`ckanapi load datasets` fails even when using `ckanapi action ckan_package_search` output, because it cannot get private datasets. CKAN returns a 404, potentially gzipped, which then gets uploaded as resource.

ckanext-scheming does not suffer of the same issue: https://github.com/ckan/ckanext-scheming/blob/a5b5522302a3cabb94f5bdb1a30a3bb7a5133403/setup.py#L27-L33

Is it something that can be rebased/reworked?

dump is different from package_search, as dump can download resources too.

Shouldn't there be a lock mechanism to avoid running the harvesting while another one is running?

Any suggestion/example on how to handle these conditionals properly?