Data Pusher

[danmihaila]

We need several improvements of the datapusher:

• [ ] to be enabled for sysadmin or admin (i will not go with editors)
• [ ] to add another button when updating a resource that will say - “add resource & push to datastore”
• [ ] dataformat?
• [ ] we wil have to perform several test. We should focus first all the resources we are using for custom pages
• [ ] field types
  • default datapusher guesses based on a sample of rows
  • how to handle incoming formats (especially for dates)
  • how to communicate failures/exceptions (one text field in a column of ints)
• [ ] data validations to perform
• [ ] potential future links with hxl validation
• [ ] use cases: https://docs.google.com/document/d/1uPwHhhHeXnmGKYOae5j6VedTcIwrrMWg6fDFdyoyn0s/edit
• [ ] We have to define what happens with a new file upload. Datastore automatically updated (but what happens with failures)? Old datastore dropped until user runs datapusher again? Default ckan behavior (mismatch of datastore and filestore). An interface must be developed. @cjhendrix and @yumiendo might come with ideas