Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

HDP 2.6.3 Installation

Highlighted

HDP 2.6.3 Installation

Explorer

Good day guys, im facing an issue with CentOS 7 HDP 2.6.3 installations, during the process the error is:

2018-01-24 16:13:24,818 - Repository['HDP-2.6-repo-52'] {'append_to_file': False, 'base_url': 'http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-52', 'mirror_list': None}
2018-01-24 16:13:24,833 - File['/etc/yum.repos.d/ambari-hdp-52.repo'] {'content': '[HDP-2.6-repo-52]\nname=HDP-2.6-repo-52\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-01-24 16:13:24,835 - Writing File['/etc/yum.repos.d/ambari-hdp-52.repo'] because contents don't match
2018-01-24 16:13:24,836 - Repository['HDP-UTILS-1.1.0.21-repo-52'] {'append_to_file': True, 'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'ambari-hdp-52', 'mirror_list': None}
2018-01-24 16:13:24,843 - File['/etc/yum.repos.d/ambari-hdp-52.repo'] {'content': '[HDP-2.6-repo-52]\nname=HDP-2.6-repo-52\nbaseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0\n\npath=/\nenabled=1\ngpgcheck=0\n[HDP-UTILS-1.1.0.21-repo-52]\nname=HDP-UTILS-1.1.0.21-repo-52\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7\n\npath=/\nenabled=1\ngpgcheck=0'}
2018-01-24 16:13:24,843 - Writing File['/etc/yum.repos.d/ambari-hdp-52.repo'] because contents don't match
2018-01-24 16:13:24,844 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2018-01-24 16:13:24,968 - Skipping installation of existing package unzip
2018-01-24 16:13:24,969 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2018-01-24 16:13:24,981 - Skipping installation of existing package curl
2018-01-24 16:13:24,981 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}
2018-01-24 16:13:24,993 - Skipping installation of existing package hdp-select
2018-01-24 16:13:25,097 - call[('ambari-python-wrap', u'/usr/bin/hdp-select', 'versions')] {}
2018-01-24 16:13:25,133 - call returned (0, '2.6.0.3-8\n2.6.3.0-235')
2018-01-24 16:13:25,551 - Command repositories: HDP-2.6-repo-52, HDP-UTILS-1.1.0.21-repo-52
2018-01-24 16:13:25,552 - Applicable repositories: HDP-2.6-repo-52, HDP-UTILS-1.1.0.21-repo-52
2018-01-24 16:13:25,554 - Looking for matching packages in the following repositories: HDP-2.6-repo-52, HDP-UTILS-1.1.0.21-repo-52
Command aborted. Reason: 'Server considered task failed and automatically aborted it'

Command failed after 1 tries

I`ve already mixed this staff with repos, selected different repositories, version,  did yum-complete-transaction --cleanup-only, no use, can anyone suggest me the solution ?

Please Help.

Thanks.



5 REPLIES 5
Highlighted

Re: HDP 2.6.3 Installation

Contributor

Check if the URL http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7 is accessible and you are write permissions to /etc/yum.repos.d/ambari-hdp-52.repo

Highlighted

Re: HDP 2.6.3 Installation

Explorer

@J Koppole

It is accessible and i do have wrote permissions, installing under root.

Highlighted

Re: HDP 2.6.3 Installation

Contributor

as it is trying to re over write means it could be stale or corrupt. clean up the file and try again.

Highlighted

Re: HDP 2.6.3 Installation

Contributor

@Adil Muganlinsky

can you verify in /etc/yum.repos.d, you only have the current versions of repo files. If not clean up the directory and keep the current version of ambari and HDP repos and try.

Highlighted

Re: HDP 2.6.3 Installation

Explorer

@Sankaru Thumuluru

I have mentioned that this issue occurs only with HDP 2.6.x, later i`ve installed 2.5 and installation was clean...

And yes, i got only current versions, i think that there are some issue with scripts as:

2018-01-25 16:07:32,156 - The 'accumulo-client' component did not advertise a version. This may indicate a problem with the component packaging. Traceback (most recent call last): File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_client.py", line 61, in <module> AccumuloClient().execute() File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 375, in execute method(env) File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_client.py", line 34, in install self.configure(env) File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 120, in locking_configure original_configure(obj, *args, **kw) File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_client.py", line 41, in configure setup_conf_dir(name='client') File "/var/lib/ambari-agent/cache/common-services/ACCUMULO/1.6.1.2.2.0/package/scripts/accumulo_configuration.py", line 32, in setup_conf_dir create_parents = True File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/python2.6/site-packages/resource_management/core/providers/system.py", line 185, in action_create sudo.makedirs(path, self.resource.mode or 0755) File "/usr/lib/python2.6/site-packages/resource_management/core/sudo.py", line 107, in makedirs raise Fail("Cannot create directory '{0}' as '{1}' is a broken symlink".format(path, dirname)) resource_management.core.exceptions.Fail: Cannot create directory '/usr/hdp/current/accumulo-client/conf' as '/usr/hdp/current/accumulo-client' is a broken symlink stdout: /var/lib/ambari-agent/data/output-566.txt 2018-01-25 16:06:11,928 - Stack Feature Version Info: Cluster Stack=2.6, Command Stack=None, Command Version=None -> 2.6 2018-01-25 16:06:11,934 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf 2018-01-25 16:06:11,935 - Group['livy'] {} 2018-01-25 16:06:11,938 - Group['spark'] {} 2018-01-25 16:06:11,939 - Adding group Group['spark'] 2018-01-25 16:06:11,967 - Group['hdfs'] {} 2018-01-25 16:06:11,968 - Adding group Group['hdfs'] 2018-01-25 16:06:11,987 - Group['zeppelin'] {} 2018-01-25 16:06:11,987 - Adding group Group['zeppelin'] 2018-01-25 16:06:12,005 - Group['hadoop'] {} 2018-01-25 16:06:12,006 - Group['users'] {} 2018-01-25 16:06:12,006 - Group['knox'] {} 2018-01-25 16:06:12,007 - Adding group Group['knox'] 2018-01-25 16:06:12,025 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,026 - Adding user User['hive'] 2018-01-25 16:06:12,055 - User['storm'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,055 - Adding user User['storm'] 2018-01-25 16:06:12,124 - User['infra-solr'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,125 - Adding user User['infra-solr'] 2018-01-25 16:06:12,180 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,181 - Adding user User['zookeeper'] 2018-01-25 16:06:12,215 - User['atlas'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,216 - Adding user User['atlas'] 2018-01-25 16:06:12,252 - User['oozie'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-01-25 16:06:12,253 - Adding user User['oozie'] 2018-01-25 16:06:12,289 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,290 - Adding user User['ams'] 2018-01-25 16:06:12,323 - User['falcon'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-01-25 16:06:12,324 - Adding user User['falcon'] 2018-01-25 16:06:12,360 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-01-25 16:06:12,360 - Adding user User['tez'] 2018-01-25 16:06:12,394 - User['zeppelin'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'zeppelin', u'hadoop'], 'uid': None} 2018-01-25 16:06:12,394 - Adding user User['zeppelin'] 2018-01-25 16:06:12,428 - User['accumulo'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,429 - Adding user User['accumulo'] 2018-01-25 16:06:12,464 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,467 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,467 - Adding user User['spark'] 2018-01-25 16:06:12,504 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users'], 'uid': None} 2018-01-25 16:06:12,504 - Adding user User['ambari-qa'] 2018-01-25 16:06:12,538 - User['flume'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,539 - Adding user User['flume'] 2018-01-25 16:06:12,581 - User['kafka'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,582 - Adding user User['kafka'] 2018-01-25 16:06:12,618 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': ['hdfs'], 'uid': None} 2018-01-25 16:06:12,619 - Adding user User['hdfs'] 2018-01-25 16:06:12,654 - User['sqoop'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,655 - Adding user User['sqoop'] 2018-01-25 16:06:12,692 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,693 - Adding user User['yarn'] 2018-01-25 16:06:12,750 - User['hbase'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,751 - Adding user User['hbase'] 2018-01-25 16:06:12,800 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,801 - Adding user User['hcat'] 2018-01-25 16:06:12,838 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,838 - Adding user User['mapred'] 2018-01-25 16:06:12,879 - User['knox'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop'], 'uid': None} 2018-01-25 16:06:12,880 - Adding user User['knox'] 2018-01-25 16:06:12,908 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-01-25 16:06:12,949 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'} 2018-01-25 16:06:12,958 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 0'] due to not_if 2018-01-25 16:06:12,958 - Directory['/tmp/hbase-hbase'] {'owner': 'hbase', 'create_parents': True, 'mode': 0775, 'cd_access': 'a'} 2018-01-25 16:06:12,959 - Changing owner for /tmp/hbase-hbase from 1025 to hbase 2018-01-25 16:06:12,960 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555} 2018-01-25 16:06:12,962 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('chan...

Don't have an account?
Coming from Hortonworks? Activate your account here