Is Kerberos enabled on the cluster? ... View more

Are you using the new Kafka consumer? (The bootstrap.servers property is required for the new consumer.) ... View more

There is a bootstrap.servers property (see https://community.hortonworks.com/articles/24599/kafka-mirrormaker.html) but I'm not sure when it's required. I'll see if I can find someone who has more info. ... View more

p.s. installing both versions (side by side) in the GA release will be integrated into the Ambari installation wizard. ... View more

In the short run it looks like you can find them at http://public-repo-1.hortonworks.com/HDP/tools/hdp_manual_install_rpm_helper_files-2.3.6.0.3796.tar.gz but RE might want to move them into a 2.3.6.0 directory. ... View more

One requirement is that Spark must be installed and running on every node where you want to install Zeppelin. ... View more

For background see https://mail-archives.apache.org/mod_mbox/spark-user/201511.mbox/%3CCA+AHuKksNyOxq8NazZA_mbHb+J1Ry-h9gMtXj=Zc5WkHU7Nnvg@mail.gmail.com%3E. Pinging @vshukla to see if he has any updates. ... View more

I hope it worked after starting the shuffle service, but fyi here are three related HDP 2.4.0 documentation pages for clusters and jobs. http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_spark-guide/content/config-dra-manual.html http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_spark-guide/content/ch_config-dea.html http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.4.0/bk_spark-guide/content/config-dra-job.html (If you're on 2.4.2, there's an equivalent set of pages under .../HDP-2.4.2/...) ... View more