Kafka for service bus

[thangchung]

Currently, Kafka only works on the local machine. We need to investigate how to make it work well on Kubernetes

How to choose the number of topics/partitions in a Kafka cluster?

https://github.com/zarusz/SlimMessageBus

References

• https://rmoff.net/2018/08/02/kafka-listeners-explained/
• https://gist.github.com/solsson/22e773ab148596ec39d54b7cc153ee67
• https://robertbrem.github.io/Microservices_with_Kubernetes/19_CQRS_with_Kafka/03_Query_service/
• https://stackoverflow.com/questions/52438822/docker-kafka-dockerized-python-application/52440056
• https://stackoverflow.com/questions/51630260/connect-to-kafka-running-in-docker-from-local-machine
• https://gist.github.com/rmoff/fb7c39cc189fc6082a5fbd390ec92b3d
• https://github.com/confluentinc/cp-helm-charts/blob/master/charts/cp-kafka/values.yaml
• https://github.com/confluentinc/cp-docker-images/blob/master/examples/cp-all-in-one/docker-compose.yml
• https://gist.github.com/abacaphiliac/f0553548f9c577214d16290c2e751071

[thangchung]

Follow the guidance at http://www.defuze.org/archives/351-running-a-zookeeper-and-kafka-cluster-with-kubernetes-on-aws.html

[thangchung]

Ui tool: https://github.com/kafka-lens/kafka-lens