hi all we notice about no option to un-install the installation of the rpm's ( when doing upgrade from 2.6.4 to 2.6.5 ) why? ... View more

hi all we are in the middle of rolling upgrade we install the HDP 2.6.5 pkgs from ambari now we perform rolling upgrade rolling upgrade window say that spark thrift servers are down and in maintenance mode this is right we stop the spark thrift services since we are not use the SPARK2_THRIFTSERVER , and not want to do spark upgrade so only spark clients and spark history are up and running but rolling upgrade cant continue because ( according to the rolling upgrade message we must to start the spark thrift services and disable the maintenance mode ) so how to continue from this stage? Reason: The following Service Components should be in a started state. Please invoke a service Stop and full Start and try again. SPARK2: SPARK2_THRIFTSERVER (in INSTALLED on host master01.sys674.com) Failed on: SPARK2 ... View more

hi all we prepare to upgrade our cluster we have HDP version - 2.6.4 and ambari - 2.6.1 we want to upgrade to the latest HDP 3.1 and latest ambari 2.7.2 what are the hortonworks document that explain this upgrade ? is it safe to jump from old HDP and ambari version to the latest ? dose hortonwoks tested this scenario ? ( upgrade HDP 2.6.4 to HDP 3.1 ) ... View more

hi all we are very confuse because un-consistence recommendation in hortonworks documents from the link: ( https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.2/bk_ambari-upgrade/content/upgrading_hdp_stack.html ) we can see that: "It is strongly recommended that you first upgrade to Ambari 2.6.2 " Note Be sure to review the available HDP upgrade scenarios below. It is strongly recommended that you first upgrade to Ambari 2.6.2 before upgrading HDP unless otherwise noted. Ambari 2.6.2 supports patch and maintenance upgrades to HDP 2.6.5.x stack. After upgrading Ambari, be sure the cluster is operating normally and service checks are passing prior to attempting an HDP upgrade. Ambari 2.6.2 does not support IOP-HDP migration. Customers migrating from IOP should use Ambari 2.6.1 to migrate IOP to HDP 2.6.4, then upgrade Ambari to 2.6.2 and use it to upgrade HDP 2.6.4 to HDP 2.6.5. but from ( https://supportmatrix.hortonworks.com/ ) we can see that HDP - 2.6.5 can be installed on ambari 2.6.1 ( means that no need to upgrade to ambari 2.6.2.2 ) so who is right here? can we install upgrade from 2.6.4 to 2.6.5 wihout upgrade ambari to 2.6.2.2? ... View more

hi all we prepare to upgrade our cluster we have HDP version - 2.6.4 and ambari - 2.6.1 we want to upgrade to HDP 2.6.5 and ambari 2.6.2.2 what are the hortonworks document that explain this upgrade ? ... View more

hi all I want to hear from hortonworks guys about the following idea we want to build the following architecture 1. ambari cluster that include ( HDP 3.1 ) 3-5 kafka machines 3 zookeper servers that are dedicated only for the kafka machines 2. ambari cluster that include all other application ( HDP 3.1 ) HDFS - service YARN - service MAPREDUCE - service HIVE - service SPARK 3 Zookeepers that dedicated to hdfs , yarn , etc data nodes machines so both cluster should talk with each other like one big cluster is this possible ? ... View more