datapusher
datapusher copied to clipboard
Datapusher settings
Hi,
I'm trying to change MAX_CONTENT_LENGTH parameter to 15728640, to editing file in /etc/ckan/datapusher_settings.py, append MAX_CONTENT_LENGTH=15728640 and restarting apache, but when I upload a file to datastore, ckan shows me next message:
Error: Resource too large to process: 10487680 > max (10485760).
Anybody knows what I'm doing wrong?
P.D: I'm using Ckan version 2.7
@carlosips You may want to take a look at the 2.7 docs for config options.
You have to adjust the max file size in your production.ini (or development.ini) file. The default is 1048576 1(MB)
there.
@boykoc ckan.resource_proxy.max_file_size parameter is used to perform in-line preview of file. My question is about an error uploading a file to datastore. You can see error message generation here:
https://github.com/ckan/datapusher/blob/master/datapusher/jobs.py#L378
I have modified jobs.py hardcoding MAX_CONTENT_LENGTH value (for testing purpose) and it works fine.
@carlosips my bad, I was thinking the ckan.max_resource_size
but you're right, that raises a different error.
I've tested this on my setup (apache, nginx, ckan 2.8.1) and have it working with a 26MB (26000000 bytes) limit. I followed the default deploy instructions.
I then updated the /etc/ckan/datapusher_settings.py
by adding MAX_CONTENT_LENGTH=26000000
as a new line. I also updated the ckan.max_resource_size=26
in my production.ini to allow a larger resource. After restarting apache it seems to be working fine.
Sorry not more help.
@boykoc thanks. I keep investigating
facing the same here... found something @carlosips ?
Nothing useful. Im sorry
is this the ckan or datapusher problem? I'm having the same.