zarakm/kafka-kubernetes

kafka-kubernetes

This project is a simple representation of how you can deploy kafka queue to kubernetes cluster with an essentil components

kafka-kubernetes's Issues

Split brain Zookeeper?

Even number of Zookeeper servers is never recommended. Also, how can your set Zookeeper ID to the same value within a functional cluster?

Could you please share from where you are getting this IP values of KAFKA_ADVERTISED_HOST_NAME

Could you please share from where you are getting this IP values of KAFKA_ADVERTISED_HOST_NAME

ava.io.IOException: Connection to 192.168.1.240:30718 (id: 0 rack: null) failed.

Hi, I followed your steps and deployed each of the yaml files into my local minikube, when I check the pods:
kubectl get pods
it listed all the 4 pods, but when I use the command:
kubectl exec --stdin --tty kafka-broker0-f8d94d678-54c8x -- /bin/sh
to shell into the kafka broker, and went to check the controller.log, it showed the following error messages, it seems it can not connect to the ip address 192.168.1.240, my local machine is a macbook, when I use command
ifconfig, I got the en0 ip: 192.168.1.2, then I used this ip to replace the 192.168.1.240, I got the same error, any clues?

Thanks!

Error when using 192.168.1.2 for name: KAFKA_ADVERTISED_HOST_NAME:

java.io.IOException: Connection to 192.168.1.2:30718 (id: 0 rack: null) failed.
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:71)
at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:292)
at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:246)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)

Error when using 192.168.1.240 for name: KAFKA_ADVERTISED_HOST_NAME:

[2021-04-23 19:45:56,793] WARN [RequestSendThread controllerId=0] Controller 0's connection to broker 192.168.1.240:30718 (id: 0 rack: null) was unsuccessful (kafka.controller.RequestSendThread)
java.io.IOException: Connection to 192.168.1.240:30718 (id: 0 rack: null) failed.
at org.apache.kafka.clients.NetworkClientUtils.awaitReady(NetworkClientUtils.java:71)
at kafka.controller.RequestSendThread.brokerReady(ControllerChannelManager.scala:292)
at kafka.controller.RequestSendThread.doWork(ControllerChannelManager.scala:246)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:96)