streaming-ops icon indicating copy to clipboard operation
streaming-ops copied to clipboard

Simulated production environment running Kubernetes targeting Apache Kafka and Confluent components on Confluent Cloud. Managed by declarative infrastructure and GitOps.

DevOps for Apache Kafka®

Simulated production environment running a streaming application targeting Kafka on Confluent Cloud. Applications and resources are managed by GitOps with declarative infrastructure, Kubernetes, and the Operator Pattern.

The full usage documentation for this project can be found on this Confluent documentation page.

This project is the subject of the following Confluent Blog post discussing the concepts of DevOps with Kubernetes and Event Streaming Platforms: DevOps for Apache Kafka® with Kubernetes and GitOps

Credits / Links

  • Significant portions of the repository are based on the work of Steven Wade @ https://github.com/swade1987
  • The script based Operator patterns in this repository are based on the shell-operator project @ https://github.com/flant/shell-operator
  • FluxCD is used for GitOps based CD
  • Bitnami Sealed Secrets are used for secret management in Kubernetes