Support Questions
Find answers, ask questions, and share your expertise

HDP 2.6.3 Installation

HDP 2.6.3 Installation

Explorer

Good day guys, im facing an issue with CentOS 7 HDP 2.6.3 installations, during the process the error is:

2018-01-24 16:13:24,818 - Repository['HDP-2.6-repo-52'] {'append_to_file': False, 'base_url': 'http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-52', 'mirror_list': None}
2018-01-24 16:13:24,833 - File['/etc/yum.repos.d/ambari-hdp-52.repo'] {'content': '[HDP-2.6-repo-52]\nname=HDP-2.6-repo-52\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-01-24 16:13:24,835 - Writing File['/etc/yum.repos.d/ambari-hdp-52.repo'] because contents don't match
2018-01-24 16:13:24,836 - Repository['HDP-UTILS-1.1.0.21-repo-52'] {'append_to_file': True, 'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-52', 'mirror_list': None}
2018-01-24 16:13:24,843 - File['/etc/yum.repos.d/ambari-hdp-52.repo'] {'content': '[HDP-2.6-repo-52]\nname=HDP-2.6-repo-52\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.21-repo-52]\nname=HDP-UTILS-1.1.0.21-repo-52\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-01-24 16:13:24,843 - Writing File['/etc/yum.repos.d/ambari-hdp-52.repo'] because contents don't match
2018-01-24 16:13:24,844 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2018-01-24 16:13:24,968 - Skipping installation of existing package unzip
2018-01-24 16:13:24,969 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2018-01-24 16:13:24,981 - Skipping installation of existing package curl
2018-01-24 16:13:24,981 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2018-01-24 16:13:24,993 - Skipping installation of existing package hdp-select
2018-01-24 16:13:25,097 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2018-01-24 16:13:25,133 - call returned (0, '2.6.0.3-8\n2.6.3.0-235')
2018-01-24 16:13:25,551 - Command repositories: HDP-2.6-repo-52, HDP-UTILS-1.1.0.21-repo-52
2018-01-24 16:13:25,552 - Applicable repositories: HDP-2.6-repo-52, HDP-UTILS-1.1.0.21-repo-52
2018-01-24 16:13:25,554 - Looking for matching packages in the following repositories: HDP-2.6-repo-52, HDP-UTILS-1.1.0.21-repo-52
Command aborted. Reason: 'Server considered task failed and automatically aborted it'

Command failed after 1 tries

I`ve already mixed this staff with repos, selected different repositories, version,  did yum-complete-transaction --cleanup-only, no use, can anyone suggest me the solution ?

Please Help.

Thanks.



5 REPLIES 5

Re: HDP 2.6.3 Installation

Contributor

Check if the URL http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 is accessible and you are write permissions to /etc/yum.repos.d/ambari-hdp-52.repo

Re: HDP 2.6.3 Installation

Explorer

@J Koppole

It is accessible and i do have wrote permissions, installing under root.

Re: HDP 2.6.3 Installation

Contributor

as it is trying to re over write means it could be stale or corrupt. clean up the file and try again.

Re: HDP 2.6.3 Installation

Contributor

@Adil Muganlinsky

can you verify in /etc/yum.repos.d, you only have the current versions of repo files. If not clean up the directory and keep the current version of ambari and HDP repos and try.

Re: HDP 2.6.3 Installation

Explorer

@Sankaru Thumuluru

I have mentioned that this issue occurs only with HDP 2.6.x, later i`ve installed 2.5 and installation was clean...

And yes, i got only current versions, i think that there are some issue with scripts as:

2018-01-25 16:07:32,156 - The 'accumulo-client' component did not advertise a version. This may indicate a problem with the component packaging. Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_client.py", line 61, in <module> AccumuloClient().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 375, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_client.py", line 34, in install self.configure(env) File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 120, in locking_configure original_configure(obj, *args, **kw) File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_client.py", line 41, in configure setup_conf_dir(name='client') File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_configuration.py", line 32, in setup_conf_dir create_parents = True File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 185, in action_create sudo.makedirs(path, self.resource.mode or 0755) File "/usr/lib/python2.6/site-packages/resource_management/core/sudo.py", line 107, in makedirs raise Fail("Cannot create directory '{0}' as '{1}' is a broken symlink".format(path, dirname)) resource_management.core.exceptions.Fail: Cannot create directory '/usr/hdp/current/accumulo-client/conf' as '/usr/hdp/current/accumulo-client' is a broken symlink stdout: /var/lib/ambari-agent/data/output-566.txt 2018-01-25 16:06:11,928 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6 2018-01-25 16:06:11,934 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-01-25 16:06:11,935 - Group['livy'] {} 2018-01-25 16:06:11,938 - Group['spark'] {} 2018-01-25 16:06:11,939 - Adding group Group['spark'] 2018-01-25 16:06:11,967 - Group['hdfs'] {} 2018-01-25 16:06:11,968 - Adding group Group['hdfs'] 2018-01-25 16:06:11,987 - Group['zeppelin'] {} 2018-01-25 16:06:11,987 - Adding group Group['zeppelin'] 2018-01-25 16:06:12,005 - Group['hadoop'] {} 2018-01-25 16:06:12,006 - Group['users'] {} 2018-01-25 16:06:12,006 - Group['knox'] {} 2018-01-25 16:06:12,007 - Adding group Group['knox'] 2018-01-25 16:06:12,025 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,026 - Adding user User['hive'] 2018-01-25 16:06:12,055 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,055 - Adding user User['storm'] 2018-01-25 16:06:12,124 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,125 - Adding user User['infra-solr'] 2018-01-25 16:06:12,180 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,181 - Adding user User['zookeeper'] 2018-01-25 16:06:12,215 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,216 - Adding user User['atlas'] 2018-01-25 16:06:12,252 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-01-25 16:06:12,253 - Adding user User['oozie'] 2018-01-25 16:06:12,289 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,290 - Adding user User['ams'] 2018-01-25 16:06:12,323 - User['falcon'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-01-25 16:06:12,324 - Adding user User['falcon'] 2018-01-25 16:06:12,360 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-01-25 16:06:12,360 - Adding user User['tez'] 2018-01-25 16:06:12,394 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop'], 'uid': None} 2018-01-25 16:06:12,394 - Adding user User['zeppelin'] 2018-01-25 16:06:12,428 - User['accumulo'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,429 - Adding user User['accumulo'] 2018-01-25 16:06:12,464 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,467 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,467 - Adding user User['spark'] 2018-01-25 16:06:12,504 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-01-25 16:06:12,504 - Adding user User['ambari-qa'] 2018-01-25 16:06:12,538 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,539 - Adding user User['flume'] 2018-01-25 16:06:12,581 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,582 - Adding user User['kafka'] 2018-01-25 16:06:12,618 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None} 2018-01-25 16:06:12,619 - Adding user User['hdfs'] 2018-01-25 16:06:12,654 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,655 - Adding user User['sqoop'] 2018-01-25 16:06:12,692 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,693 - Adding user User['yarn'] 2018-01-25 16:06:12,750 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,751 - Adding user User['hbase'] 2018-01-25 16:06:12,800 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,801 - Adding user User['hcat'] 2018-01-25 16:06:12,838 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,838 - Adding user User['mapred'] 2018-01-25 16:06:12,879 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,880 - Adding user User['knox'] 2018-01-25 16:06:12,908 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-01-25 16:06:12,949 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2018-01-25 16:06:12,958 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2018-01-25 16:06:12,958 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'} 2018-01-25 16:06:12,959 - Changing owner for /tmp/hbase-hbase from 1025 to hbase 2018-01-25 16:06:12,960 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-01-25 16:06:12,962 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('chan...