Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2829 | 04-27-2020 03:48 AM | |
| 5503 | 04-26-2020 06:18 PM | |
| 4682 | 04-26-2020 06:05 PM | |
| 3712 | 04-13-2020 08:53 PM | |
| 5622 | 03-31-2020 02:10 AM |
06-28-2019
02:38 AM
1 Kudo
@Michael Bronson Zookeeper is a light weight process hence it won't consume too much resource. (EDIT😞 However there is the following recommendation from Hortonworks (For Kafka + Zookeeper) : https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.4/bk_kafka-component-guide/content/kafka-zookeeper-multiple-apps.html Here are several recommendations for ZooKeeper configuration with Kafka: Do not run ZooKeeper on a server where Kafka is running. When using ZooKeeper with Kafka you should dedicate ZooKeeper to Kafka, and not use ZooKeeper for any other components. Make sure you allocate sufficient JVM memory. A good starting point is 4GB. To monitor the ZooKeeper instance, use JMX metrics. . As far as high availability is concerned for zookeepers then you can refer to the following HCC thread which talks about more on How to decide, how many zookeepers should I have? https://community.hortonworks.com/questions/35287/how-to-decide-how-many-zookeepers-should-i-have.html it depends on your requirement and then based on the requirement we can decide the number of ZK hosts as 3 or 5 (..etc). More ZK comes with a cost so please go through the above thread.
... View more
06-28-2019
02:20 AM
1 Kudo
@Michael Bronson Please refer to the following link which provides the HDP 2.6.4 offline repos. https://docs.hortonworks.com/HDPDocuments/Ambari-2.6.1.5/bk_ambari-installation/content/hdp_26_repositories.html . From that link based on your OS type you can download the "HDP-2.6.4.0-XXXXX-rpm.tar.gz" files and then after extracting that file you should eb able to find the Zookeeper RPM as well. Example for CentOs7 (RHEL7) RPMs for HDP2.6.4 http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.4.0/HDP-2.6.4.0-centos7-rpm.tar.gz
... View more
06-27-2019
12:19 PM
1 Kudo
@Michael Bronson Kafka uses zookeeper https://kafka.apache.org/documentation/#brokerconfigs , hence in HDP common services you will find that Kafka has a dependency to Zookeeper. Example: # grep -B4 -A4 'ZOOKEEPER' /var/lib/ambari-server/resources/common-services/KAFKA/0.8.1/metainfo.xml
<versionAdvertised>true</versionAdvertised>
<rollingRestartSupported>true</rollingRestartSupported>
<dependencies>
<dependency>
<name>ZOOKEEPER/ZOOKEEPER_SERVER</name>
<scope>cluster</scope>
<auto-deploy>
<enabled>true</enabled>
</auto-deploy>
--
<scriptType>PYTHON</scriptType>
<timeout>300</timeout>
</commandScript>
<requiredServices>
<service>ZOOKEEPER</service>
</requiredServices>
<configuration-dependencies>
<config-type>kafka-broker</config-type>
<config-type>kafka-env</config-type> . https://github.com/apache/ambari/blob/release-2.6.2/ambari-server/src/main/resources/common-services/KAFKA/0.8.1/metainfo.xml#L34-L42
... View more
06-27-2019
06:15 AM
@Chhaya Vishwakarma Also can you please share the exact steps that you have performed after upgrading the Ambari Server binaries from 2.7.0 to 2.7.3.
... View more
06-27-2019
06:13 AM
@Chhaya Vishwakarma 0. Are you entering the Correct Ambari Server Host Name & Port in the rest URL ? (or by mistake it is pointing to a freshly installed ambari server host) ? 1. Are you sure that ambari DB was not reset? (Did some one rest the ambari DB) 2. Do you see the cluster creation wizard shown when you login to the UI ? (if yes then may be the ambari DB is reset or ambari server is pointing to wrong DB which does not have cluster info) 3. Please grep the Ambari DB details from the following output and then check the "clusters" table detail. # grep jdbc /etc/ambari-server/conf/ambari.properties 4. What output do you see when you run the following SQL query in amabri DB? # SELECT * FROM clusters; 5. Can you please share the complete output of "/var/log/ambari-server/ambari-server.log"
... View more
06-27-2019
05:52 AM
@Chhaya Vishwakarma Good to know that the original issue reported as part of the HCC thread is resolved. It will be great if you mark this HCC thread as "Answered" by clicking the "Accept" button on the correct answer. For the new issue please open a Separate HCC thread so HCC users will be able to browse single query/with single solution as part of this thread.
... View more
06-27-2019
05:44 AM
1 Kudo
@Alampally Vinith The error indicates that your MySQL Server seems may not be running healthy. The MYSQl server is not responding to the jdbc call of the driver. Please check DB connection properties. com.mysql.jdbc.exceptions.jdbc4.CommunicationsException: Communications link failure
The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server . Please try to restart your MySQL Server and then verify the mysql connectivity from oozie host. .
... View more
06-27-2019
03:47 AM
@Chhaya Vishwakarma As you are using PPC system so can you please try using the PPC repo instead? # wget -nv http://public-repo-1.hortonworks.com/ambari/centos7-ppc/2.x/updates/2.7.3.0/ambari.repo -O /etc/yum.repos.d/ambari.repo
# yum clean all
# yum upgrade ambari-server https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation-ppc/content/download_the_ambari_repo.html Your ambari.repo should be looking like this for IBM Power Systems (PPC) #VERSION_NUMBER=2.7.3.0-139
[ambari-2.7.3.0]
#json.url = http://public-repo-1.hortonworks.com/HDP/hdp_urlinfo.json
name=ambari Version - ambari-2.7.3.0
baseurl=http://public-repo-1.hortonworks.com/ambari/centos7-ppc/2.x/updates/2.7.3.0
gpgcheck=1
gpgkey=http://public-repo-1.hortonworks.com/ambari/centos7-ppc/2.x/updates/2.7.3.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1 .
... View more
06-27-2019
03:02 AM
@Chhaya Vishwakarma May be your ambari binaries are already upgraded. Can you please share the output of the following command? Does it show 2.7.3 ? # rpm -qa | grep ambari . If you see that ambari server binaries are already updated then you can take AMbari Server DB dump and then go for ambari server schema upgrade as described in following link . Upgrade Ambari Server database schema. On the host running Ambari Server: # ambari-server upgrade https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-upgrade-major/content/upgrade_ambari.html
... View more
06-26-2019
01:47 PM
1 Kudo
@Krishna Srinivas The above queries which you shared ... Unfortunately deletes the "HBase Service" completely from Ambari DB. Which means Ambari will not show that HBase service anymode in the Ambari UI as, an Installed service. But it is best if you can take a backup of the "hbase.rootdir" property of your HBase just to avoid loosing the Hbase Data. Then in Ambari UI click on "Add Service" and then choose "Hbase" to install it on the same host. To see if it works?
... View more