Support Questions
Find answers, ask questions, and share your expertise

i cannot install hdp 2.6 cluster on rhel

i cannot install hdp 2.6 cluster on rhel

 
7 REPLIES 7

Re: i cannot install hdp 2.6 cluster on rhel

Super Mentor

@Rakesh Uppalapati

What error are you getting?

Re: i cannot install hdp 2.6 cluster on rhel

stderr: /var/lib/ambari-agent/data/errors-332.txt
Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py", line 37, in <module>
    BeforeInstallHook().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 314, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/hook.py", line 34, in hook
    install_packages()
  File "/var/lib/ambari-agent/cache/stacks/HDP/2.0.6/hooks/before-INSTALL/scripts/shared_initialization.py", line 37, in install_packages
    retry_count=params.agent_stack_retry_count)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install
    self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 51, in install_package
    self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 86, in checked_call_with_retries
    return self._call_with_retries(cmd, is_checked=True, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 98, in _call_with_retries
    code, out = func(cmd, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
    raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install hdp-select' returned 1. Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-2.5. Please verify its path and try again
stdout: /var/lib/ambari-agent/data/output-332.txt
2017-06-20 00:18:40,988 - Stack Feature Version Info: stack_version=2.5, version=None, current_cluster_version=None -> 2.5
2017-06-20 00:18:40,989 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf
User Group mapping (user_group) is missing in the hostLevelParams
2017-06-20 00:18:40,991 - Group['livy'] {}
2017-06-20 00:18:40,993 - Group['spark'] {}
2017-06-20 00:18:40,996 - Adding group Group['spark']
2017-06-20 00:18:41,011 - Group['hadoop'] {}
2017-06-20 00:18:41,011 - Group['users'] {}
2017-06-20 00:18:41,012 - Group['knox'] {}
2017-06-20 00:18:41,014 - Adding group Group['knox']
2017-06-20 00:18:41,035 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:41,038 - Adding user User['hive']
2017-06-20 00:18:41,252 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:41,255 - Adding user User['storm']
2017-06-20 00:18:41,416 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:41,420 - Adding user User['zookeeper']
2017-06-20 00:18:41,609 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:41,612 - Adding user User['ams']
2017-06-20 00:18:41,773 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2017-06-20 00:18:41,776 - Adding user User['tez']
2017-06-20 00:18:41,939 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:41,941 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:41,943 - Adding user User['spark']
2017-06-20 00:18:42,118 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['users']}
2017-06-20 00:18:42,121 - Adding user User['ambari-qa']
2017-06-20 00:18:42,285 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:42,286 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:42,289 - Adding user User['hdfs']
2017-06-20 00:18:42,451 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:42,454 - Adding user User['yarn']
2017-06-20 00:18:42,740 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:42,744 - Adding user User['mapred']
2017-06-20 00:18:42,913 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:42,917 - Adding user User['hbase']
2017-06-20 00:18:43,074 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:43,077 - Adding user User['knox']
2017-06-20 00:18:43,241 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hadoop']}
2017-06-20 00:18:43,244 - Adding user User['hcat']
2017-06-20 00:18:43,406 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-06-20 00:18:43,409 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}
2017-06-20 00:18:43,414 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if
2017-06-20 00:18:43,415 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'}
2017-06-20 00:18:43,415 - Creating directory Directory['/tmp/hbase-hbase'] since it doesn't exist.
2017-06-20 00:18:43,415 - Changing owner for /tmp/hbase-hbase from 0 to hbase
2017-06-20 00:18:43,416 - Changing permission for /tmp/hbase-hbase from 700 to 775
2017-06-20 00:18:43,417 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}
2017-06-20 00:18:43,418 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] {'not_if': '(test $(id -u hbase) -gt 1000) || (false)'}
2017-06-20 00:18:43,423 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh hbase /home/hbase,/tmp/hbase,/usr/bin/hbase,/var/log/hbase,/tmp/hbase-hbase'] due to not_if
2017-06-20 00:18:43,424 - Group['hdfs'] {}
2017-06-20 00:18:43,427 - Adding group Group['hdfs']
2017-06-20 00:18:43,449 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': ['hadoop', 'hdfs']}
2017-06-20 00:18:43,450 - Modifying user hdfs
2017-06-20 00:18:43,481 - FS Type: 
2017-06-20 00:18:43,482 - Directory['/etc/hadoop'] {'mode': 0755}
2017-06-20 00:18:43,482 - Creating directory Directory['/etc/hadoop'] since it doesn't exist.
2017-06-20 00:18:43,483 - Changing permission for /etc/hadoop from 700 to 755
2017-06-20 00:18:43,483 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}
2017-06-20 00:18:43,483 - Changing owner for /var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir from 11978 to hdfs
2017-06-20 00:18:43,508 - Initializing 2 repositories
2017-06-20 00:18:43,509 - Repository['HDP-2.5'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.0.0', 'action': ['create'], 'components': ['HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP', 'mirror_list': None}
2017-06-20 00:18:43,529 - File['/etc/yum.repos.d/HDP.repo'] {'content': '[HDP-2.5]\nname=HDP-2.5\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.0.0\n\npath=/\nenabled=1\ngpgcheck=0'}
2017-06-20 00:18:43,531 - Repository['HDP-UTILS-1.1.0.21'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6', 'action': ['create'], 'components': ['HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}
2017-06-20 00:18:43,540 - File['/etc/yum.repos.d/HDP-UTILS.repo'] {'content': '[HDP-UTILS-1.1.0.21]\nname=HDP-UTILS-1.1.0.21\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos6\n\npath=/\nenabled=1\ngpgcheck=0'}
2017-06-20 00:18:43,541 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-06-20 00:18:43,832 - Skipping installation of existing package unzip
2017-06-20 00:18:43,833 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-06-20 00:18:44,020 - Skipping installation of existing package curl
2017-06-20 00:18:44,020 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2017-06-20 00:18:44,212 - Installing package hdp-select ('/usr/bin/yum -d 0 -e 0 -y install hdp-select')
2017-06-20 00:18:44,566 - Execution of '/usr/bin/yum -d 0 -e 0 -y install hdp-select' returned 1. Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-2.5. Please verify its path and try again
2017-06-20 00:18:44,566 - Failed to install package hdp-select. Executing '/usr/bin/yum clean metadata'
2017-06-20 00:18:44,776 - Retrying to install package hdp-select after 30 seconds
 

Command failed after 1 tries

Re: i cannot install hdp 2.6 cluster on rhel

Super Mentor

@Rakesh Uppalapati

Can you please check if you have Internet access from the mentioned host?

Are you able to access the HDP repo from that host?

Please try to do the following:

# wget http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.0.0/repodata/repomd.xml
# wget http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.0.3/repodata/repomd.xml

.

Also you mentioned that you are trying to install HDP 2.6 but from your Output it looks like you have incorrect HDP repo present inside your "/etc/yum.repos.d/" directory hence we see the HDP 2.5 there:

2017-06-20 00:18:43,529 - File['/etc/yum.repos.d/HDP.repo'] {'content': '[HDP-2.5]\nname=HDP-2.5\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.0.0\n\npath=/\nenabled=1\ngpgcheck=0'}

.

If you have any HDP 2.5 version of HDP.repo file present inside the "/etc/yum.repos.d/" directory then remove it and then freshly try installing.

# grep 'HDP-2.5' /etc/yum.repos.d/*.repo
# yum clean all

.

If you are installing Cluster from Ambari UI then please double check the "Stack & Version" that you have choosen for creating the HDP 2.6 cluster ( your output shows it is usign HDP 2.5)

.

Re: i cannot install hdp 2.6 cluster on rhel

I cannot find HDP 2.5 rpm and access it from my network even bypassing proxy

Re: i cannot install hdp 2.6 cluster on rhel

Super Mentor

@Rakesh Uppalapati

Your output shows that you have incorrect HDP version (2.5) entry in the file "/etc/yum.repos.d/HDP.repo" , Where as you said you want to install HDP 2.6. So please remove that file from there.

2017-06-2000:18:43,529-File['/etc/yum.repos.d/HDP.repo']{'content':'[HDP-2.5]

.

Also can you please share the output of this file?

# cat /etc/yum.repos.d/HDP.repo

.

Or else you can download the HDP repo file from: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.6.1/bk_command-line-installation/content/config...

Example:

wget -nv http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.6.1.0/hdp.repo -O /etc/yum.repos.d/hdp.repo

.

Re: i cannot install hdp 2.6 cluster on rhel

[root@sbl70000753 ~]# wget http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.0.0/repodata/repomd.xml --2017-06-20 11:01:55-- http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.5.0.0/repodata/repomd.xml Resolving public-repo-1.hortonworks.com... failed: Name or service not known. wget: unable to resolve host address “public-repo-1.hortonworks.com”

Re: i cannot install hdp 2.6 cluster on rhel

Super Mentor

@Rakesh Uppalapati

The following error indicates that you might not have internet access on the host.

wget: unable to resolve host address “public-repo-1.hortonworks.com”

.

Please make sure that internet connectivity is available for package downloads or else configure the Offline Repository. As described in: https://docs.hortonworks.com/HDPDocuments/Ambari-2.5.1.0/bk_ambari-installation/content/setting_up_a...