Hi.
This is my setup:
- 3 kafka hosts with 2 networks
- private internal network for data
- public for connection with everything else
+--------------------------------------------------------------------------------------------------+
| | | 10.25.12.0/24 - PUBLIC |
| |
| --------------------------------------------------------------- |
| | | | |
| | | | |
| | | | |
| +------------+ +------------+ +------------+ |
| | | | | | | |
| | | | | | | |
| | KFK-1 | | KFK-2 | | KFK-3 | |
| | | | | | | |
| | | | | | | |
| +------------+ +------------+ +------------+ |
| | | | |
| - | | |
| | | | |
| | | | |
| --------------------------------------------------------------- |
| 192.168.160.0/24 - PRIVATE |
| server.properties |
| advertised.listeners=PLAINTEXT://10.25.12.[1,2,3]:6667 |
| listeners=PLAINTEXT://0.0.0.0:6667 |
| inter.broker.listener.name=PLAINTEXT://192.168.160.[1,2,3] |
| zookeeper.connect=kfk-1.domain.tld:2181,kfk-2.domain.tld:2181,kfk-3.domain.tld:2181 |
| |
+--------------------------------------------------------------------------------------------------+
Every host, to use the data network is routed through the hosts file to the internal one:
#INTERNAL NETWORK
192.168.160.1 kfk-1.domain.tld
192.168.160.2 kfk-2.domain.tld
192.168.160.3 kfk-3.domain.tld
The problem:
If i try to connect from the outside to a round-robin hostname which contains all the 3 public private addresses of the kafka-brokes using zookeeper (kafka.domain.tld:2181) > works
If i try to connect to ANY of the brokers directly using bootstrat-server > doesnt even throw me and error.
I tried placing on the advertised.listeners:
- plaintext://kfk-[1,2,3].domain.tld:6667 >> connect but can not find the leader
- plaintext://0.0.0.0:6667 >> dont connect
- plaintext://kafka.domain.tld:6667 >> dont connect
Running HDP 2.6.1.
I am ran out of ideas.....any clue?
