datapusher-plus
datapusher-plus copied to clipboard
dathere
A standalone web service that pushes data into the CKAN Datastore fast & reliably. It pushes real good!
When pushing a file with german locale (Uses , instead of . for decimal point). Numbers are parsed as Text. ```csv "Kennziffer","Einheit","12.06.1994","13.06.1999","13.06.2004","07.06.2009","25.05.2014","26.05.2019" "Wahlbeteiligung","%","57,957","41,84699","39,0107","41,86174","42,6241","61,59743" "GRÜNE","%","10,16194","4,992445","12,1425","13,09138","12,38852","20,18807" ```  I have set the...
Hey there, thank's for the greate work on DP+. There is one important feature I'm currently missing: I'm using DP+ in Kubernetes cluster. Apparently, DP+ can't rewirte resource urls, if...
**Describe the bug** In the specific context of the Texas Water Data Hub schema, we run the datapusher resubmit command nightly to update resources using the following command: ``` ckan...
tab and pipe delimiter csv's not working as intended, I tried enabling `SNIFF_DELIMITER=true` but didn't help. However, the semicolon delimiter is working. Here are the example csv's i used: [example_tsv.csv](https://github.com/datopian/client-metropole-ruhr-shared/files/11877599/tsv.csv)...
A little error on the README about the development installation (point 7) : `cd /usr/lib/ckan/**dpplus_env**/src/datapusher-plus/datapusher ` but the directory created at the point 2 is **_dpplus_venv_** : `sudo python3.8 -m...
**Describe the bug** Datapusher stuck with pending status, when i check the datapusher log it's throwing the below error. ``` datapusher-plus | During handling of the above exception, another exception...
**Describe the bug** When using datapusher-plus-docker to run datapusher-plus, with the following config parameters set: PREVIEW_ROWS=1000 ADD_SUMMARY_STATS_RESOURCE=True SUMMARY_STATS_WITH_PREVIEW=True DOWNLOAD_PREVIEW_ONLY=True There appears to be a problem with having DOWNLOAD_PREVIEW_ONLY=True Setting DOWNLOAD_PREVIEW_ONLY=False...
The legacy Datapusher used to support PDFs, as messytables supported extracting tables from PDFs using pdftables. That functionality has been removed, as well as Excel support. We reenabled Excel support...
As you can see, I am putting your plugin through the paces ;) When I submit all the datasets at once, some get this error message:  When I retry,...
## OVERALL VISION: To increase the utility and performance of the CKAN Datastore: - by enriching resources, so that right after a file is pushed by DP+, it does a...