Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Datanode failed to install Ambari cluster

Highlighted

Datanode failed to install Ambari cluster

New Contributor

I am trying to intsall a HDP cluster using Ambari ( public repository ), I went through the different steps , but at the last strp , the data node intsllation fail and I get the following message :

stderr: <script id="metamorph-234-start" type="text/x-placeholder"></script>Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py", line 37, in <module> BeforeInstallHook().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 374, in execute self.save_component_version_to_structured_out(self.command_name) File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 244, in save_component_version_to_structured_out stack_select_package_name = stack_select.get_package_name() File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/stack_select.py", line 109, in get_package_name package = get_packages(PACKAGE_SCOPE_STACK_SELECT, service_name, component_name) File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/stack_select.py", line 223, in get_packages supported_packages = get_supported_packages() File "/usr/lib/python2.6/site-packages/resource_management/libraries/functions/stack_select.py", line 147, in get_supported_packages raise Fail("Unable to query for supported packages using {0}".format(stack_selector_path)) resource_management.core.exceptions.Fail: Unable to query for supported packages using /usr/bin/hdp-select<script id="metamorph-234-end" type="text/x-placeholder"></script> stdout: <script id="metamorph-236-start" type="text/x-placeholder"></script>2017-11-20 00:11:25,437 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6 2017-11-20 00:11:25,438 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2017-11-20 00:11:25,439 - Group['hdfs'] {} 2017-11-20 00:11:25,441 - Group['hadoop'] {} 2017-11-20 00:11:25,441 - Group['users'] {} 2017-11-20 00:11:25,441 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2017-11-20 00:11:25,442 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop'], 'uid': None} 2017-11-20 00:11:25,443 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users'], 'uid': None} 2017-11-20 00:11:25,444 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None} 2017-11-20 00:11:25,444 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2017-11-20 00:11:25,446 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2017-11-20 00:11:25,451 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2017-11-20 00:11:25,452 - Group['hdfs'] {} 2017-11-20 00:11:25,452 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hdfs', 'hdfs']} 2017-11-20 00:11:25,453 - FS Type: 2017-11-20 00:11:25,453 - Directory['/etc/hadoop'] {'mode': 0755} 2017-11-20 00:11:25,454 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777} 2017-11-20 00:11:25,470 - Repository['HDP-2.6-repo-1'] {'append_to_file': False, 'base_url': 'http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.3.0', 'action': ['create'], 'components': ['HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2017-11-20 00:11:25,494 - File['/etc/yum.repos.d/ambari-hdp-1.repo'] {'content': '[HDP-2.6-repo-1]\nname=HDP-2.6-repo-1\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.3.0\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-11-20 00:11:25,495 - Writing File['/etc/yum.repos.d/ambari-hdp-1.repo'] because contents don't match 2017-11-20 00:11:25,496 - Repository['HDP-UTILS-1.1.0.21-repo-1'] {'append_to_file': True, 'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6', 'action': ['create'], 'components': ['HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-1', 'mirror_list': None} 2017-11-20 00:11:25,499 - File['/etc/yum.repos.d/ambari-hdp-1.repo'] {'content': '[HDP-2.6-repo-1]\nname=HDP-2.6-repo-1\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.3.0\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.21-repo-1]\nname=HDP-UTILS-1.1.0.21-repo-1\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6\n\npath=/\nenabled=1\ngpgcheck=0'} 2017-11-20 00:11:25,499 - Writing File['/etc/yum.repos.d/ambari-hdp-1.repo'] because contents don't match 2017-11-20 00:11:25,507 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-11-20 00:11:25,594 - Skipping installation of existing package unzip 2017-11-20 00:11:25,594 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-11-20 00:11:25,606 - Skipping installation of existing package curl 2017-11-20 00:11:25,606 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-11-20 00:11:25,618 - Skipping installation of existing package hdp-select Command failed after 1 tries <script id

1 REPLY 1

Re: Datanode failed to install Ambari cluster

Super Mentor
@Haifa Ben Aouicha

We see the messages like:

2017-11-20 00:11:25,606 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2017-11-20 00:11:25,618 - Skipping installation of existing package hdp-select Command failed after 1 tries 

.

It indicates that this particular DataNode might have multiple version of HDP 2.6 components already installed on it. So the "hdp-select" package might be belonging to older version of HDP 2.6.0 (instead of HDP 2.6.3).

.

Please check the output of the following commands and share the output from the failing datanode host. "hdp-select" command will provide you the details about the HDP version that is installed to this host and the "/usr/hdp" directory content will list the other version of HDP version directories present inside that folder.

# hdp-select
# ls -lart /usr/hdp/
# rpm -qa | grep hdp-select

.

The "rpm -qa | grep hdp-select" command will show if the hdp-select binary is installed from HDP 2.6.0.0 repo or from HDP 2.6.3. If the version mismatch then we might need to upgrade the hdp-select to the current hdp version (HDP 2.6.3)

.

Also please check if any of your yum repo is pointing to the old HDP repo inside the "/etc/yum.repos.d" , If yes then please edit those repos and then set the "enabled=0" in those files so that only the HDP 2.6.3 yum repo file is enabled when multiple HDP repos are present there.

# yum clean all
# yum repolist

.

Don't have an account?
Coming from Hortonworks? Activate your account here