ckanext-xloader icon indicating copy to clipboard operation
ckanext-xloader copied to clipboard

High availability setup

Open clauded opened this issue 5 years ago • 1 comments

We're planning to deploy our CKAN setup with high availability (two CKAN servers, one db container, one solr container and one redis container). We would like to have xloader highly available as well.

  • Is there a problem if we install the extension on both CKAN servers?
  • Is there any possible conflicts doing so?
  • Any special configuration to do?

clauded avatar May 21 '20 17:05 clauded

HA XLoader is certainly possible. However, there is an increased risk of slowdowns and database transaction deadlocks when datasets have a high number of resources and different XLoader instances compete over them.

We have a setup that puts XLoader on its own server(s), and no special configuration is needed; it just needs the CKAN configuration file, and access to the database and Redis queue, just like CKAN would.

ThrawnCA avatar Oct 04 '22 04:10 ThrawnCA