Some of the pages require tunneling: Manage HDInsight clusters by using the Ambari Web UI https://azure.microsoft.com/en-us/documentation/articles/hdinsight-hadoop-manage-ambari/ ... View more

Make sure you use SSL via httpS. See https://azure.microsoft.com/en-us/documentation/articles/hdinsight-hadoop-manage-ambari/ ... View more

No way to kerberize Kafka in 2.2 If you are running storm-2.2 you should still be able to run a topology that uses storm-kafka connector's version from version 2.3 which should be able to read from a secure kafka cluster (HDP or not HDP). ... View more

If you use the same partitions for yarn intermediate data than for the HDFS blocks, then you might also consider setting the fs.datanode.du.reserved property, which reserves some space on those partitions for non-hdfs use (such as intermediate yarn data). One base recommendation I saw on my first Hadoop training long time ago was to dedicate 25% of the "data disks" for that kind of intermediate data. I guess the optimal answer should consider the maximum amount of intermediate data you can get at the same time (when launching a job, do you use all the data of HDFS as input data?) and dedicate the space for yarn.nodemanager.resource.local-dirs accordingly. I would also recommend turning on the property mapreduce.map.output.compress in order to reduce the size of the intermediate data. ... View more