We are running a hadoop 2.6.1 cluster and we are configured two networks:
a) bond WAN> 10.25.0.0/16
b) bond DATA > 192.168.160.0/24
The hadoop nodes has one network interface with the same last octect in every network.
The hostname is on the host files of the nodes.
It is impossible to make the kafka work. I got always this message when i try to connect to the kafka producer broker from another machine. Firewall is ok.
[2018-03-15 15:09:50,924] ERROR Error when sending message to topic kafka_mirror_test with key: null, value: 5 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback)
HDP 2.6.1 running all the services (hdfs, hive, kafka, pig, zookeeper, etc) in every node.