You are right, because Ambari supports only one ZK quorum, if you have 6 ZKs in your blueprint you will end up with a single 6-node ZK quorum, and you cannot change that using zkcli. Instead you can try: 1 cluster (a): Install the cluster from your blueprint without Kafka and with only 3 ZK nodes. When the cluster is up and running install the second, Kafka ZK quorum manually, you can find instructions here. Finally, add Kafka using Ambari and set its ZK quorum to the one you istalled manually. 1 cluster (b): Install the cluster from blueprint including Kafka and 3 ZK nodes. Then install another ZK manually using the above link, and change Kafka settings to use the new Zookeeper. I'd avoid this solution because the first Kafka will be "poluted" by Kafka ZK directories. 1 cluster (c), your solution with 6 ZK nodes: Remove 3 ZK nodes using Ambari and then install another ZK manually and change Kafka settings like in 1(b). 2 clusters: Install one cluster with all services but without Kafka and its Zookeeper, and one more Kafka-only cluster having only Kafka and its Zookeeper. This is the easiest solution because you can automate cluster deployment using Ambari, and you can monitor all your components using Ambari, but you will have 2 clusters. ... View more

You need an additional, temporary table to read your input file, and then some date conversion: hive> create table tmp(a string, b string) row format delimited fields terminated by ','; hive> load data local inpath 'a.txt' overwrite into table tmp; hive> create table mytime(a string, b timestamp); hive> insert into table mytime select a, from_unixtime(unix_timestamp(b, 'dd-MM-yyyy HH:mm')) from tmp; hive> select * from mytime; a 2015-11-20 22:07:00 b 2015-08-17 09:45:00 ... View more

scala> val a = sc.textFile("/user/.../path/to/your/file").map(x => x.split("\t")).filter(x => x(0) != x(1)) scala> a.take(4) res2: Array[Array[String]] = Array(Array(1, 4), Array(2, 5), Array(1, 5)) Try the snippet above, just insert the path to your file on hdfs. ... View more