@Silvio del Val
Yes, you can install and manage the second set of Kafka brokers manually (not through Ambari). As for Zookeeper, it can manage multiple Kafka clusters. Just "chroot" them differently
{zookeeperHost}:{portnumber}/{kafkacluster1}
&
{zookeeperHost}:{portnumber}/{kafkacluster2}
Take a look at the link below on how zookeeper manages sessions and on chroot.
https://zookeeper.apache.org/doc/r3.2.2/zookeeperProgrammers.html#ch_zkSessions
To do this:
1) Create the chroot in Zookeeper with the below commands
zkCli.sh -server yourZookeeperHost:2181
# note the empty brackets below are _required_
create /kafkaCluster1 []
This will create a path called "kafkaCluster1". You can verify this by running the "ls/" command.
(* replace "yourZookeeperHost" and the port number with the appropriate values from you environment)
2) For the Kafka brokers configs, under "zookeeper.connect", add a "chroot" path which will make all kafka data for this cluster appear under that particular path. To do this give a connection string in the form kafka_v08_1:port1,kafka_v08_2:port2,kafka_v08_3:port3 yourZookeeperHost:2181/kafkaCluster1 which would put all this cluster's data under the path yourZookeeperHost:2181/kafkaCluster1.
3) For the Kafka consumer configs, under "zookeeper.connect", input the same as you did in step 2 for the brokers
4) Repeat steps 1-3 for your second Kafka cluster using a different "chroot" path
For more explanation of Kafka configs take a look at the below link.
https://kafka.apache.org/08/documentation/#configuration
