Cloudera Community
mike_bronson7
user rank
Guru

Re: upgrade HDP and ambari to the latest versions

by Guru in Support Questions
‎07-04-2019 05:40 AM
‎07-04-2019 05:40 AM
@Dear Jay , thank you so much for the grate answer , just one additional question - about my post ( https://community.hortonworks.com/questions/248726/hdp-upgrade-from-264-to-265-is-it-necessary-to-upg.html ) , its not clearly if I can to upgrade HDP to 2.6.5 from 2.6.4 without ambari upgrade from 2.6.1 to. 2.6.2 so in simple words - can we just upgrade from 2.6.4 to 2.6.5 while ambari will stay with version - 2.6.1 ? its very important because on the matrix version the answer is yes but from hortonworks document the answer is different so we are very confused here - please help us to know the final answer ... View more

upgrade HDP and ambari to the latest versions

by Guru in Support Questions
‎07-03-2019 03:35 PM
‎07-03-2019 03:35 PM
hi all we prepare to upgrade our cluster we have HDP version - 2.6.4 and ambari - 2.6.1 we want to upgrade to the latest HDP 3.1 and latest ambari 2.7.2 what are the hortonworks document that explain this upgrade ? is it safe to jump from old HDP and ambari version to the latest ? dose hortonwoks tested this scenario ? ( upgrade HDP 2.6.4 to HDP 3.1 ) ... View more

HDP upgrade from 2.6.4 to 2.6.5 is it necessary to...

by Guru in Support Questions
‎07-03-2019 11:47 AM
‎07-03-2019 11:47 AM
hi all we are very confuse because un-consistence recommendation in hortonworks documents from the link: ( https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.2.2/bk_ambari-upgrade/content/upgrading_hdp_stack.html ) we can see that: "It is strongly recommended that you first upgrade to Ambari 2.6.2 " Note Be sure to review the available HDP upgrade scenarios below. It is strongly recommended that you first upgrade to Ambari 2.6.2 before upgrading HDP unless otherwise noted. Ambari 2.6.2 supports patch and maintenance upgrades to HDP 2.6.5.x stack. After upgrading Ambari, be sure the cluster is operating normally and service checks are passing prior to attempting an HDP upgrade. Ambari 2.6.2 does not support IOP-HDP migration. Customers migrating from IOP should use Ambari 2.6.1 to migrate IOP to HDP 2.6.4, then upgrade Ambari to 2.6.2 and use it to upgrade HDP 2.6.4 to HDP 2.6.5. but from ( https://supportmatrix.hortonworks.com/ ) we can see that HDP - 2.6.5 can be installed on ambari 2.6.1 ( means that no need to upgrade to ambari 2.6.2.2 ) so who is right here? can we install upgrade from 2.6.4 to 2.6.5 wihout upgrade ambari to 2.6.2.2? ... View more

upgrade HDP and ambari from 2.6.4 and ambari 2.6.1

by Guru in Support Questions
‎07-03-2019 09:34 AM
‎07-03-2019 09:34 AM
hi all we prepare to upgrade our cluster we have HDP version - 2.6.4 and ambari - 2.6.1 we want to upgrade to HDP 2.6.5 and ambari 2.6.2.2 what are the hortonworks document that explain this upgrade ? ... View more

Re: 2 ambari clusters in one big cluster

by Guru in Support Questions
‎07-02-2019 03:26 AM
‎07-02-2019 03:26 AM
@DEAR Jay "clusters running separately and still be able to establish communication between Kafka cluster to the other cluster which has all the services " can you please explain in basic details what are the configuration on both cluster to enable contamination between one ambari cluster to the ambari cluster that include the kafka? ... View more

2 ambari clusters in one big cluster

by Guru in Support Questions
‎07-01-2019 09:42 PM
‎07-01-2019 09:42 PM
hi all I want to hear from hortonworks guys about the following idea we want to build the following architecture 1. ambari cluster that include ( HDP 3.1 ) 3-5 kafka machines 3 zookeper servers that are dedicated only for the kafka machines 2. ambari cluster that include all other application ( HDP 3.1 ) HDFS - service YARN - service MAPREDUCE - service HIVE - service SPARK 3 Zookeepers that dedicated to hdfs , yarn , etc data nodes machines so both cluster should talk with each other like one big cluster is this possible ? ... View more

Re: Should zookeeper be run on independent machine...

by Guru in Support Questions
‎07-01-2019 08:57 AM
‎07-01-2019 08:57 AM
@Dear Jay you said - "Kafka and Zookeepers are two services that are sensitive to disk I/O. Keeping them on same node will not be a good idea. " I agree but lets say that: assume we install the zookeeper on kafka machine but zookeeper will write the logs to the disk of the OS and not the disk of the kafka and we disable the swap on the kafka machine is this change the picture ? I mean in that case zookeeper not use the disk of kafka and use the disk of the OS of the kafka + disable swap in that case you agree ? ... View more

Re: topics are with negative number and Isr is emp...

by Guru in Support Questions
‎07-01-2019 08:24 AM
‎07-01-2019 08:24 AM
what you mean about - "also check the offline partitions metric to confirm this " ? ... View more

Re: topics are with negative number and Isr is emp...

by Guru in Support Questions
‎07-01-2019 08:18 AM
‎07-01-2019 08:18 AM
@Geoffrey Shelton Okot all brokers are up always and replication factor is 3 ... View more

Re: Should zookeeper be run on independent machine...

by Guru in Support Questions
‎07-01-2019 06:29 AM
‎07-01-2019 06:29 AM
@Dear Jay now its more clear - but why? what is the reason that we shouldn't install zoo on kafka ? second can we install zoo on data node machine ? ( when zoo is dedicated and serve only to kafka ) ... View more
Contact Me
Online
Offline
Last Visited
‎08-27-2024 09:17 AM
Community Statistics
Member Since ‎08-08-2017 09:40 AM
Last Visited ‎08-27-2024 09:17 AM
Posts 1,652
Kudos received 29