datasync
datasync copied to clipboard
Ability to publish CSV/TSV files accessible on an FTP server
This would enable setting the fileToPublish to be a file accessible via FTP (i.e. ftp://data.city.org/datafile.csv). So instead of having the CSV/TSV on the local machine or networked drive it can be obtained directly by DataSync from an FTP server.
This feature did not make it into the release because we were not able to do enough QA testing to ensure it was reliable. The source code to enable this is commented out here in the master branch: https://github.com/socrata/datasync/blob/master/src/main/java/com/socrata/datasync/FTPUtility.java#L583
We are considering this feature for the next release of DataSync.