Member since
03-14-2016
4721
Posts
1111
Kudos Received
874
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 2714 | 04-27-2020 03:48 AM | |
| 5273 | 04-26-2020 06:18 PM | |
| 4443 | 04-26-2020 06:05 PM | |
| 3566 | 04-13-2020 08:53 PM | |
| 5375 | 03-31-2020 02:10 AM |
06-02-2017
12:55 PM
@Joshua Adeleke
Those WARNING messages are related to BUG: https://issues.apache.org/jira/browse/AMBARI-20875 which will be addressed in the Ambari 2.5.2 The ERRORs indicates DB corruption. That needs to be fixed manually.
... View more
06-02-2017
11:37 AM
1 Kudo
@Jitendra Yadav Can you please check which user has the permission to read write this file? # ls -la /etc/yum.repos.d/ambari.repo
-rw-r--r--. 1 root root 304 May 31 17:08 /etc/yum.repos.d/ambari.repo . You can verify the same using this Python script" import os
import pwd
print 'Who Owns it: ' + pwd.getpwuid(os.stat("/etc/yum.repos.d/ambari.repo").st_uid).pw_name . Now If do the following: # useradd 55025
# chown 55025 /etc/yum.repos.d/ambari.repo . Then you will see 55025 in the output.
... View more
06-02-2017
09:52 AM
@Joshua Adeleke Or alternatively you might have to set the Engine to "InnoDB" as following for all those listed table names in your Mysql db and then restart the ambari server. ALTER TABLE DS_XXXXX ENGINE=InnoDB; . And for some other tables like "ClusterHostMapping", "hostgroup_configuration" etc if not set already.
... View more
06-02-2017
09:45 AM
@Joshua Adeleke Yes, it looks like an issue looks related to: https://issues.apache.org/jira/browse/AMBARI-18951 https://github.com/apache/ambari/commit/80084a9d8de9110365c6f1ef68362b502e07cf28 . Prior to Ambaei 2.5 some of the DB tables for MySQL might be using the "MyISAM" engin instead of "InnoDB". As a work around you can try the following approach to fix the issue. # Collect the Ambari DB Dump.
mysqldump -U ambari -p ambari > /PATH/TO/ambari.original.mysql
cp /PATH/TO/ambari.original.mysql /tmp/ambari.innodb.mysql
# Now Replace the engine with INNODB (Earlier it might be MyISAM)
sed -ie 's/MyISAM/INNODB/g' /PATH/TO/ambari.innodb.mysql
# Drop and recreate Ambari DB as following:
mysql -u ambari -p ambari
mysql> DROP DATABASE ambari;
mysql> CREATE DATABASE ambari;
# Import new DB with correct storage engine
mysql -u ambari -pbigdata --force ambari < /PATH/TO/ambari.innodb.mysql .
... View more
06-02-2017
07:31 AM
@ed day The link that you shared to migrate from Derby to MySQL seems to be too old (2013) and there are many changes and enhancements made in hive. I do not see "Derby" database in the supported list of Databases in: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.0/bk_support-matrices/content/ch_matrices-hdp.html So if this is your fresh cluster then you should install Hive with the supported databases to avoid the DB issues. HDP 2.6 Hive Database Requirements PostgreSQL 9.1.13+, 9.3, 9.4***
MariaDB 10*
MySQL 5.6****
Oracle 11gr2
Oracle 12c**
By default (on RHEL/CentOS/Oracle Linux 6), Ambari installs an instance of MySQL
on the Hive Metastore host. Otherwise, you need to use an existing instance of
PostgreSQL, MySQL or Oracle.
.
... View more
06-02-2017
05:02 AM
@Lian Jiang Else you can also try adding the following repo in your "~/.m2/settings.xml" <settings>
<mirrors>
<mirror>
<id>public</id>
<mirrorOf>*</mirrorOf>
<url>http://repo.hortonworks.com/content/groups/public</url>
</mirror>
</mirrors>
</settings>
As i see it here as well : http://repo.hortonworks.com/content/groups/public/org/apache/maven/wagon/wagon-ssh-external/maven-metadata.xml .
... View more
06-02-2017
04:55 AM
@Lian Jiang Can you try adding the following entries in your "~/.m2/settings.xml" to see if it allows you to build. <settings>
<mirrors>
<mirror>
<id>public</id>
<mirrorOf>*</mirrorOf>
<url>http://nexus-private.hortonworks.com/nexus/content/groups/public</url>
</mirror>
</mirrors>
</settings> . As i see that maven package here: http://nexus-private.hortonworks.com/nexus/content/groups/public/org/apache/maven/wagon/wagon-ssh-external/maven-metadata.xml
... View more
06-02-2017
03:29 AM
@white wartih
From your previous log snippet shows that the "RANGER_KMS" is also not installed properly hence it is in "INSTALL_FAILED" state.
org.apache.ambari.server.AmbariException: Invalid transition for servicecomponenthost, clusterName=<mycluster>, clusterId=2, serviceName=RANGER_KMS, componentName=RANGER_KMS_SERVER,
hostname=<myhostname> currentState=INSTALL_FAILED, newDesiredState=STARTED
From your attached log we see that the "RANGER" service is not installed properly it is currently in "INSTALL_FAILED" state: org.apache.ambari.server.AmbariException: Invalid transition for servicecomponenthost, clusterName=bb, clusterId=2, serviceName=RANGER, componentName=RANGER_ADMIN, hostname=<myhostname>, currentState=INSTALL_FAILED, newDesiredState=STARTED
We will suggest you to completely remove the "RANGER" and "RANGER_KMS" services first and then try adding them freshly because they are not installed properly. If you face any error/issue during installing these services then please let us know.
Either Using Ambari UI or Using API call as well we can try deleting those services (if that does not work due to some issues then let us know) # curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://<AMBARi_SERVER_HOST>:8080/api/v1/clusters/<$CLUSTER_NAME>/services/RANGER_KMS
# curl -u admin:admin -H "X-Requested-By: ambari" -X DELETE http://<AMBARi_SERVER_HOST>:8080/api/v1/clusters/<$CLUSTER_NAME>/services/RANGER .
... View more
06-01-2017
03:05 PM
@Tamil Selvan K You might also want to try the following using "--tree-requiers" to see dependency tree. # repoquery --tree-requires --recursive --resolve ambari-server .
... View more
06-01-2017
02:48 PM
1 Kudo
@Tamil Selvan K We can query the depepdencies using "repoquery" which is available as part of package "yum-utils"
Example: # yum install yum-utils -y
And then you can try something like this.
# for i in `rpm -qa | grep hadoop` ; do echo "Package [$i]:"; rpm -q --requires $i ; echo ; done
Example: For ambari dependencies on CentOS6 for i in `rpm -qa | grep ambari-server` ; do echo "Package [$i]:"; rpm -q --requires $i ; echo ; done
Package [ambari-server-2.5.0.3-7.x86_64]:
postgresql-server >= 8.1
openssl
python >= 2.6
/bin/sh
/bin/sh
/bin/sh
/bin/sh
rpmlib(PartialHardlinkSets) <= 4.0.4-1
rpmlib(FileDigests) <= 4.6.0-1
rpmlib(PayloadFilesHavePrefix) <= 4.0-1
rpmlib(CompressedFileNames) <= 3.0.4-1
rpmlib(PayloadIsXz) <= 5.2-1 .
... View more