Service to re-import into CKAN Datastore + Github service hook for this

[rufuspollock]

I change a CSV and want it re-imported to CKAN datastore

• Could be general CSV or one specifically referenced from a CKAN resource
• Nice tie-in (initial focus?) would be csvs in github where we have service notifications so this whole process can be automated

Implementation

http://ckan-importer.com/?url=...&dest=ckan-resource-url&apikey=zzz&tableinfo=...

• use new data conversion service to convert CSV to JSON ...
• we pass api key in url - not perfect but a start

Github Service - Bonus Points

• Github service hook to trigger this ...

[rufuspollock]

@domoritz / @kindly - may be useful to take a look over this a related use case to ckan importer.

[domoritz]

Just a few pointers.

• The service https://github.com/okfn/ckan-importer-service
• The framework that makes functions available as a service https://github.com/okfn/ckan-service-provider
• The data converters library https://github.com/okfn/data-converters

[rufuspollock]

@domoritz thanks - though I'm of course aware of those ;-) I note that my reason for putting this up here (the basic item had been in a file on my disk for last 3+ months) was more about the github service hook at this point since I knew that ckan-service-importer is in progress (and when complete will definitely resolve the "Service to re-import into CKAN Datastore" requirement. I've renamed the issue to reflect the 2 parts (basic importers + github service hook)

[rufuspollock]

See also: https://github.com/ckan/ideas-and-roadmap/issues/18 (CKAN importer service).