Support Questions

Find answers, ask questions, and share your expertise

Encountered problem in installtion of HDP cluster using ambari 2.6

New Contributor

ambari-server-1.zip

Hello,

We have encountered problem in installtion of HDP cluster using ambari 2.6

OS : Linux CentOS 7

Also, for your reference we have attached ambari-server.log file to have look on the issue.
Kindly go through it and analyze the issue.

Thanks and Regards,

Lavish Patodi

1 REPLY 1

New Contributor

Hello,

FYI

Error Log :

2017-12-18 17:51:21,517 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6 2017-12-18 17:51:21,521 - Using hadoop conf dir: /usr/hdp/2.6.3.0-235/hadoop/conf 2017-12-18 17:51:21,522 - Group['livy'] {} 2017-12-18 17:51:21,523 - Group['spark'] {} 2017-12-18 17:51:21,523 - Group['hdfs'] {} 2017-12-18 17:51:21,523 - Group['hadoop'] {} 2017-12-18 17:51:21,523 - Group['users'] {} 2017-12-18 17:51:21,524 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,524 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,525 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,526 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,526 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2017-12-18 17:51:21,527 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,528 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,529 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2017-12-18 17:51:21,529 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,530 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,531 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None} 2017-12-18 17:51:21,531 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,532 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,533 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2017-12-18 17:51:21,533 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2017-12-18 17:51:21,535 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2017-12-18 17:51:21,543 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2017-12-18 17:51:21,544 - Group['hdfs'] {} 2017-12-18 17:51:21,544 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', u'hdfs']} 2017-12-18 17:51:21,544 - FS Type: 2017-12-18 17:51:21,545 - Directory['/etc/hadoop'] {'mode': 0755} 2017-12-18 17:51:21,555 - File['/usr/hdp/2.6.3.0-235/hadoop/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'} 2017-12-18 17:51:21,556 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2017-12-18 17:51:21,566 - Repository['HDP-2.6-repo-2'] {'append_to_file': False, 'base_url': 'http://PRDIQIP1C09.bss.jio.com/V1/HDP/centos7/2.6.3.0-235', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-2', 'mirror_list': None} 2017-12-18 17:51:21,572 - File['/etc/yum.repos.d/ambari-hdp-2.repo'] {'content': '[HDP-2.6-repo-2]\nname=HDP-2.6-repo-2\nbaseurl=http://PRDIQIP1C09.bss.jio.com/V1/HDP/centos7/2.6.3.0-235\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-12-18 17:51:21,572 - Writing File['/etc/yum.repos.d/ambari-hdp-2.repo'] because contents don't match 2017-12-18 17:51:21,572 - Repository['HDP-UTILS-1.1.0.21-repo-2'] {'append_to_file': True, 'base_url': 'http://PRDIQIP1C09.bss.jio.com/V1/HDP-UTILS', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-2', 'mirror_list': None} 2017-12-18 17:51:21,575 - File['/etc/yum.repos.d/ambari-hdp-2.repo'] {'content': '[HDP-2.6-repo-2]\nname=HDP-2.6-repo-2\nbaseurl=http://PRDIQIP1C09.bss.jio.com/V1/HDP/centos7/2.6.3.0-235\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.21-repo-2]\nname=HDP-UTILS-1.1.0.21-repo-2\nbaseurl=http://PRDIQIP1C09.bss.jio.com/V1/HDP-UTILS\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-12-18 17:51:21,575 - Writing File['/etc/yum.repos.d/ambari-hdp-2.repo'] because contents don't match 2017-12-18 17:51:21,576 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-18 17:51:21,659 - Skipping installation of existing package unzip 2017-12-18 17:51:21,659 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-18 17:51:21,667 - Skipping installation of existing package curl 2017-12-18 17:51:21,668 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-18 17:51:21,676 - Skipping installation of existing package hdp-select 2017-12-18 17:51:21,679 - The repository with version 2.6.3.0-235 for this command has been marked as resolved. It will be used to report the version of the component which was installed 2017-12-18 17:51:21,886 - MariaDB RedHat Support: false 2017-12-18 17:51:21,890 - Using hadoop conf dir: /usr/hdp/2.6.3.0-235/hadoop/conf 2017-12-18 17:51:21,899 - call['ambari-python-wrap /usr/bin/hdp-select status hive-server2'] {'timeout': 20} 2017-12-18 17:51:21,922 - call returned (0, 'hive-server2 - 2.6.3.0-235') 2017-12-18 17:51:21,923 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6 2017-12-18 17:51:21,943 - File['/var/lib/ambari-agent/cred/lib/CredentialUtil.jar'] {'content': DownloadSource('http://prdiqip1c09.bss.jio.com:8080/resources/CredentialUtil.jar'), 'mode': 0755} 2017-12-18 17:51:21,945 - Not downloading the file from http://prdiqip1c09.bss.jio.com:8080/resources/CredentialUtil.jar, because /var/lib/ambari-agent/tmp/CredentialUtil.jar already exists 2017-12-18 17:51:21,945 - checked_call[('/usr/jdk64/jdk1.8.0_112/bin/java', '-cp', u'/var/lib/ambari-agent/cred/lib/*', 'org.apache.ambari.server.credentialapi.CredentialUtil', 'get', 'javax.jdo.option.ConnectionPassword', '-provider', u'jceks://file/var/lib/ambari-agent/cred/conf/hive_metastore/hive-site.jceks')] {} 2017-12-18 17:51:22,439 - checked_call returned (0, 'SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".\nSLF4J: Defaulting to no-operation (NOP) logger implementation\nSLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.\nDec 18, 2017 5:51:22 PM org.apache.hadoop.util.NativeCodeLoader <clinit>\nWARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable\nbigdata123') 2017-12-18 17:51:22,447 - Command repositories: HDP-2.6-repo-2, HDP-UTILS-1.1.0.21-repo-2 2017-12-18 17:51:22,447 - Applicable repositories: HDP-2.6-repo-2, HDP-UTILS-1.1.0.21-repo-2 2017-12-18 17:51:22,448 - Looking for matching packages in the following repositories: HDP-2.6-repo-2, HDP-UTILS-1.1.0.21-repo-2 2017-12-18 17:51:24,206 - Adding fallback repositories: HDP-2.6-repo-1, HDP-UTILS-1.1.0.21-repo-1 2017-12-18 17:51:25,912 - Package['hive_2_6_3_0_235'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-18 17:51:26,000 - Skipping installation of existing package hive_2_6_3_0_235 2017-12-18 17:51:26,003 - Package['hive_2_6_3_0_235-hcatalog'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-18 17:51:26,012 - Skipping installation of existing package hive_2_6_3_0_235-hcatalog 2017-12-18 17:51:26,014 - Package['hive_2_6_3_0_235-webhcat'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-12-18 17:51:26,023 - Skipping installation of existing package hive_2_6_3_0_235-webhcat 2017-12-18 17:51:26,024 - No package found for hive2_${stack_version}(hive2_(\d|_)+$) 2017-12-18 17:51:26,027 - The repository with version 2.6.3.0-235 for this command has been marked as resolved. It will be used to report the version of the component which was installed

Thanks and Regards,
Lavish Patodi