@maha Rm The latest ambari version that is released is 2.6.1.5: https://docs.hortonworks.com/HDPDocuments/Ambari/Ambari-2.6.1.5/index.html So if you want to upgrade to the latest available ambari server (2.6.1.5) then you can refer to the following doc: https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-upgrade/content/upgrading_ambari.html ... View more

I would suggest you use HDFS connect rather than Spark Streaming as it is more fault tolerant. Kafka Connect is built into the base Kafka libraries, but you need to compile and add HDFS Connect separately to the classpath of Connect. Build from here: https://github.com/confluentinc/kafka-connect-hdfs and use a tagged branch rather than master as the releases are publicly available libraries, not SNAPSHOT builds that require you to compile Kafka from source. ... View more

Hi Maha: Please confirm that the broker is indeed listening at localhost:6667 by attempting to connect to it via nc or a similar utlity. Example: nc -v localhost 6667 If you are unable to connect, then verify that the broker is running and that it is running on the machine where you are issuing the console producer command. If it is running on a separate machine, you will need to replace the "localhost" with the hostname of that separate machine. Thank you, Jeff Groves ... View more