datapusher-plus
datapusher-plus copied to clipboard
dathere
A standalone web service that pushes data into the CKAN Datastore fast & reliably. It pushes real good!
DP+ was forked from DP which uses ckanserviceprovider. ckanserviceprovider was meant to be a general library for CKAN for making web services, and was originally created in 2013. Right now,...
I am using ckan behind a proxy which uses another internal authentication. Datapusher Plus (on the `fixing-issues`) branch is mostly aware of the `CKAN__DATAPUSHER__CALLBACK_URL_BASE`, but seems to be missing the...
`psql /copy` is MUCH faster than psycopg2 `copy_expert()` Inserting a 50mb CSV file took all of 2 seconds for `psql /copy` and 215 seconds for psycopg2 `copy_expert` - 100x faster,...
Currently, the datapusher-plus project leverages the [CKAN Service Provider](https://github.com/ckan/ckan-service-provider) that was meant to be a general library for CKAN for making web services, and was originally created in 2013. As...
Alpine being a gift that keeps giving, musl iconv doesn't have output parameter at all, so this replaces it by using file descriptor.
As the `dev-v1.0` branch is almost ready, we can start removing API calls and start using CKAN internal actions. @jqnatividad also we could refactor the qsv part a bit
It would be nice if somewhere in the logs generated during a push it indicated the DP+ version number. I'd suggest maybe in the status message at the end, for...
After installing DataPusher-Plus for development following the instructions on: https://github.com/dathere/datapusher-plus#datapusher-database-setup . After successful installation of `pip install datapusher-plus` within the suggested environment: `. /usr/lib/ckan/dpplus_venv/bin/activate`. I get the following error after...
My file /etc/ckan/datapusher-plus/.env is not considered. I had to edit /usr/lib/ckan/dpplus_venv/lib/python3.8/site-packages/datapusher/config.py so that datapusher can push a more big file than 25 Mo and connect to my datastore database. Ubuntu...
Hi! I am running CKAN 2.9 on Ubuntu 20.04 I am trying the manual deployment of datapusher-plus but get the following error: ``` sqlalchemy.exc.OperationalError: (psycopg2.OperationalError) connection to server at "localhost"...
