I have a 6 node HDP 2.5 cluster(1 Edge, 1 Master, 1 Secondary Master, 3 Data Nodes) running on Azure VM's. I am looking to install Kafka on on that cluster. I wanted to have Kafka Connect API, Kafka Streams API alongwith that. I went on to "add service" in Ambari and i shows Kafka 0.10 with HDP 2.5.
What would the best way to install kafka in my case on HDP 2.5? How many brokers should i be installing and where to run brokers and zookeeper?
Any help would be appreciated.
Thanks in Advance.