Member since
12-23-2016
59
Posts
2
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
10121 | 01-26-2017 08:16 PM |
01-27-2017
05:40 PM
This is fresh installation of Ambari 2.1 with HDP 2.3. I am using Ambari to install the HDP services. There was typo from my side under Select
Stack --> Advance Repository options for red hat 6 OS with HDP 2.3 version the base url is
pointing http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.6.0. I corrected the location ass per hdp.repo located under /etc/yum.repo.d/ to use http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.3.4.7. However, after correcting the base url location I am still getting same issue. Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py", line 147, in <module>
ApplicationTimelineServer().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 218, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/YARN/2.1.0.2.0/package/scripts/application_timeline_server.py", line 38, in install
self.install_packages(env)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 376, in install_packages
Package(name)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 45, in action_install
self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package
shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput())
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
tries=tries, try_sleep=try_sleep)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'hadoop_2_3_*-yarn'' returned 1. Error: Package: zookeeper_2_3_6_0_3796-3.4.6.2.3.6.0-3796.el6.noarch (HDP-2.3)
Requires: hdp-select >= 2.3.6.0-3796
Installed: hdp-select-2.3.4.7-4.el6.noarch (@HDP-2.3.4.7)
hdp-select = 2.3.4.7-4.el6
Error: Package: hadoop_2_3_6_0_3796-2.7.1.2.3.6.0-3796.el6.x86_64 (HDP-2.3)
Requires: hdp-select >= 2.3.6.0-3796
Installed: hdp-select-2.3.4.7-4.el6.noarch (@HDP-2.3.4.7)
hdp-select = 2.3.4.7-4.el6
You could try using --skip-broken to work around the problem
You could try running: rpm -Va --nofiles --nodigest Please advise. Thank you, Sachin A
... View more
01-27-2017
12:41 AM
stderr: Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/hdfs_client.py", line 120, in <module>
HdfsClient().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 218, in execute
method(env) File "/var/lib/ambari-agent/cache/common-services/HDFS/2.1.0.2.0/package/scripts/hdfs_client.py", line 34, in install
self.install_packages(env, params.exclude_packages) File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 376, in install_packages
Package(name) File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 154, in __init__
self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 152, in run
self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 118, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 45, in action_install
self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos) File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package
shell.checked_call(cmd, sudo=True, logoutput=self.get_logoutput()) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 70, in inner
result = function(command, **kwargs) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 92, in checked_call
tries=tries, try_sleep=try_sleep) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 140, in _call_wrapper
result = _call(command, **kwargs_copy) File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 291, in _call
raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install 'hadoop_2_3_*'' returned 1. Error: Package: zookeeper_2_3_6_0_3796-3.4.6.2.3.6.0-3796.el6.noarch (HDP-2.3)
Requires: hdp-select >= 2.3.6.0-3796 Installed: hdp-select-2.3.4.7-4.el6.noarch (@HDP-2.3.4.7)
hdp-select = 2.3.4.7-4.el6 Error: Package: hadoop_2_3_6_0_3796-2.7.1.2.3.6.0-3796.el6.x86_64 (HDP-2.3) Requires: hdp-select >= 2.3.6.0-3796 Installed: hdp-select-2.3.4.7-4.el6.noarch (@HDP-2.3.4.7) hdp-select = 2.3.4.7-4.el6 You could try using --skip-broken to work around the problem You could try running: rpm -Va --nofiles --nodigest
... View more
Labels:
- Labels:
-
Hortonworks Data Platform (HDP)
01-26-2017
09:38 PM
Thanks for your quick response. Your solution worked. Now there are no errors in ambari-server.log file. Thank you, Sachin A
... View more
01-26-2017
08:47 PM
Do I need to rerun below command with mysql-connector-java for version 5.1.40 or just unlink the existing one and redirect to the new mysql-connector-java.jar? ambari-server setup --jdbc-db=mysql --jdbc-driver=/usr/share/java/mysql-connector-java.jar Please advise. Thank you, Sachin A
... View more
01-26-2017
08:43 PM
Ambari version is 2.1 I have uploaded log file. Issue looks similar to what mentioned in below link. https://community.hortonworks.com/content/supportkb/48751/ambari-log-reports-you-have-an-error-in-your-sql-s.html What is the stable mysql-connector-java.jar version? As per the link Note: Connector version 5.1.37 has been observed to have issues with some of the Batch operations in Ambari. Please advise, Thank you, Sachin A
... View more
01-26-2017
08:20 PM
ambari-server-log.zip
... View more
01-26-2017
08:16 PM
Thanks for the quick response. The issue was with the password in /etc/ambari-server/conf/password.dat file. There are couple of follow up questions: 1) While setting up ambari server it didn't allowed me to enter any special character. Enter Database Password (bigdata): Invalid characters in password. Use only alphanumeric or _ or - characters Enter Database Password (bigdata): 2) After successfully starting ambari server is ambari-server.log file is filling up with errors. As log file is continuously growing up with errors I am uploading the log file. [ambari@ambari ~]$ ambari-server start Using python /usr/bin/python2.6 Starting ambari-server Organizing resource files at /var/lib/ambari-server/resources... Unable to check firewall status when starting without root privileges. Please do not forget to disable or adjust firewall if needed Server PID at: /var/run/ambari-server/ambari-server.pid Server out at: /var/log/ambari-server/ambari-server.out Server log at: /var/log/ambari-server/ambari-server.log Waiting for server start.................... Ambari Server 'start' completed successfully. 3) Even after stopping ambari server I see that log file is filling up. [ambari@ambari ~]$ ambari-server stop Using python /usr/bin/python2.6 Stopping ambari-server Ambari Server is not running [ambari@ambari ~]$ ambari-server status Using python /usr/bin/python2.6 Ambari-server status Ambari Server not running. Stale PID File at: /var/run/ambari-server/ambari-server.pid [ambari@ambari ~]$ ps -ef|grep ambari root 2223 1928 0 11:30 pts/1 00:00:00 su - ambari
ambari 2224 2223 0 11:30 pts/1 00:00:00 -bash
ambari 2735 1 0 12:02 pts/1 00:00:00 /bin/sh -c ulimit -n 10000 ; /usr/jdk64/jdk1.8.0_40/bin/java -server -XX:NewRatio=3 -XX:+UseConcMarkSweepGC -XX:-UseGCOverheadLimit -XX:CMSInitiatingOccupancyFraction=60 -Dsun.zip.disableMemoryMapping=true -Xms512m -Xmx2048m -Djava.security.auth.login.config=/etc/ambari-server/conf/krb5JAASLogin.conf -Djava.security.krb5.conf=/etc/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false -cp /etc/ambari-server/conf:/usr/lib/ambari-server/*:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-connector-java-5.1.17.jar org.apache.ambari.server.controller.AmbariServer > /var/log/ambari-server/ambari-server.out 2>&1 || echo $? > /var/run/ambari-server/ambari-server.exitcode &
ambari 2736 2735 28 12:02 pts/1 00:03:30 /usr/jdk64/jdk1.8.0_40/bin/java -server -XX:NewRatio=3 -XX:+UseConcMarkSweepGC -XX:-UseGCOverheadLimit -XX:CMSInitiatingOccupancyFraction=60 -Dsun.zip.disableMemoryMapping=true -Xms512m -Xmx2048m -Djava.security.auth.login.config=/etc/ambari-server/conf/krb5JAASLogin.conf -Djava.security.krb5.conf=/etc/krb5.conf -Djavax.security.auth.useSubjectCredsOnly=false -cp /etc/ambari-server/conf:/usr/lib/ambari-server/*:/usr/share/java/mysql-connector-java.jar:/usr/share/java/mysql-connector-java-5.1.17.jar org.apache.ambari.server.controller.AmbariServer
ambari 2899 2224 0 12:14 pts/1 00:00:00 ps -ef
ambari 2900 2224 0 12:14 pts/1 00:00:00 grep ambari Please advise. Thank you, Sachin A
... View more
01-26-2017
07:54 PM
Here is the ambari-server.out file in zip format
... View more
01-26-2017
07:49 PM
Not able to start ambari server as non root user (ambari) after fresh installation. [ambari@ambari ~]$ ambari-server start Using python /usr/bin/python2.6 Starting ambari-server Organizing resource files at /var/lib/ambari-server/resources... Unable to check firewall status when starting without root privileges. Please do not forget to disable or adjust firewall if needed Server PID at: /var/run/ambari-server/ambari-server.pid
Server out at: /var/log/ambari-server/ambari-server.out
Server log at: /var/log/ambari-server/ambari-server.log Waiting for server start.................... ERROR: Exiting with exit code -1. REASON: Ambari Server java process died with exitcode 1. Check /var/log/ambari-server/ambari-server.out for more information. As per log file the issue seems to be database connectivity, however, I am able to login to the database [ambari@ambari ~]$ mysql -u ambari -p -h ambari.localdomain Enter password: Welcome to the MySQL monitor. Commands end with ; or \g. Your MySQL connection id is 114
Server version: 5.7.17 MySQL Community Server (GPL) Copyright (c) 2000, 2016, Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its
affiliates.Other names may be trademarks of their respective
owners.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> select current_user(); +---------------------------+ | current_user() | +---------------------------+ | ambari@ambari.localdomain |
+---------------------------+ 1 row in set (0.00 sec) Please advise.
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
01-24-2017
01:55 AM
Thank you for your response. I have couple of more questions on the exam. 1) Am I allowed to use documentation during exam? As per below link it says "Candidates for the HDPCA exam are provided access to the HPD 2.3 documentation pages". http://hortonworks.com/training/certification/hdp-certified-developer-faq-page/
Am I allowed access to documentation?
Yes. Candidates for the HDPCD exam are provided access to the Pig, Hive, Sqoop and Flume documentation pages. Candidates for the HDPCA exam are provided access to the HPD 2.3 documentation pages. Candidates for the HDPCD:Java exam will have access to the Apache Hadoop documentation. 2) How to approach the troubleshooting questions in the exam? For example, if there is a question with some mapreduce program output error or some service startup error or error related while running exam task? Are we allowed to use any search engine? Please advise. Thank you, Sachin A
... View more
- « Previous
- Next »