conductor icon indicating copy to clipboard operation
conductor copied to clipboard

Published 20 hours ago • verified publisher icon Netflix

[DOC]: how to make conductor deployment production ready

Open ishallbethat opened this issue 2 years ago • 1 comments

What are you missing in the docs

I'd like to know how to make conductor deployment production ready. in production ready environment it needs at least automatic failover, autoscaling, high availability. Is there any documention on this ?

ishallbethat avatar Sep 20 '22 04:09 ishallbethat

This issue is stale, because it has been open for 45 days with no activity. Remove the stale label or comment, or this will be closed in 7 days.

github-actions[bot] avatar Nov 05 '22 00:11 github-actions[bot]

This issue was closed, because it has been stalled for 7 days with no activity.

github-actions[bot] avatar Nov 13 '22 00:11 github-actions[bot]

Hi @ishallbethat when we deploy conductor in prod here is what we ensure we have:

  1. setup for failover - we use redis cluster or setup that has primary and replica that can be promoted to primary in case of failures
  2. Automated backups of databases
  3. We use k8s for deployments and use metrics for servers and workers to decide on scaling policies (CPU for conductor servers and queue depths for workers to autoscale)
  4. Metrics setup - we use prometheus and grafana to monitor various metrics and configuring alerts

v1r3n avatar Nov 13 '22 03:11 v1r3n