Adrian Laurenzi

Enable DataSync to act as an adaptor to publish data from Pentaho

2

The simplest way to achieve this would be to enable configuring a DataSync job by passing command line parameters as an alternative to running a saved job file. Then a...

When datatype is invalid in one row in the Row Identifier column the error message is incorrect.

1

Repro steps: use upsert or replace method to upload a CSV file where one value in the Row Identifier column is the wrong datatype (i.e. text in a number column)...

Ability to publish CSV/TSV files accessible on an FTP server

1

This would enable setting the fileToPublish to be a file accessible via FTP (i.e. ftp://data.city.org/datafile.csv). So instead of having the CSV/TSV on the local machine or networked drive it can...

Currently porting data requires that the schemas of source and destination datasets are identical. We should enable porting to a destination dataset that has subset of columns of the source.

This will be useful to notify people if they accidentally moved or deleted a .sij file that a scheduling or other external tool was using. Currently an error is thrown...

Documentation on scheduling Pentaho Kettle transformations on Windows

1

Chicago's ETL toolkit documents how to schedule on UNIX but not Windows.

Add docs on how to get count of all rows in a dataset

3

Multiple people asked about this at Hack for LA and also in other contexts. Might be appropriate to add on this page: http://dev.socrata.com/docs/functions/count.html

Issuing DELETE verb to a SODA endpoint can be used to delete records from a dataset (by Row ID or truncate all rows) but is not yet documented.

This will require establishing an ordering mechanism (currently its alphabetical).