Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Issue in Hive client and Hcat client installation

Issue in Hive client and Hcat client installation

New Contributor

Traceback (most recent call last):

File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 85, in <module>

HCatClient().execute()

File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute

method(env)

File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 35, in install

self.install_packages(env)

File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 693, in install_packages

retry_count=agent_stack_retry_count)

File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__

self.env.run()

File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run

self.run_action(resource, action)

File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action

provider_action()

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install

self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/zypper.py", line 59, in install_package

self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 86, in checked_call_with_retries

return self._call_with_retries(cmd, is_checked=True, **kwargs)

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 98, in _call_with_retries

code, out = func(cmd, **kwargs)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner

result = function(command, **kwargs)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call

tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper

result = _call(command, **kwargs_copy)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call

raise ExecutionFailed(err_msg, code, out, err)

resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/zypper --quiet install --auto-agree-with-licenses --no-confirm mysql-client' returned 106. Download (curl) error for 'http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.6.0/hdp.repo/repodata/repomd.xml':

Error code: Connection failed

Error message: Failed to connect to public-repo-1.hortonworks.com port 80: Connection timed out

Abort, retry, ignore? [a/r/i/...? shows all options] (a): a

Error building the cache:

[HDP-2.5|http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.6.0/hdp.repo] Valid metadata not found at specified URL

Warning: Skipping repository 'HDP-2.5' because of the above error.

Download (curl) error for 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12/repodata/repomd.xml':

Error code: Connection failed

Error message: Failed to connect to public-repo-1.hortonworks.com port 80: Connection timed out

Abort, retry, ignore? [a/r/i/...? shows all options] (a): a

Error building the cache:

[HDP-UTILS-1.1.0.21|http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12] Valid metadata not found at specified URL

Warning: Skipping repository 'HDP-UTILS-1.1.0.21' because of the above error.

File 'repomd.xml' from repository 'saprepo' is unsigned, continue? [yes/no] (no): no

Error building the cache:

[saprepo|http://ls0110.wdf.sap.corp:8080/pub/linux/suse/x86_64/saprepo/SLES-12/] Valid metadata not found at specified URL

Warning: Skipping repository 'saprepo' because of the above error.

Some of the repositories have not been refreshed because of an error.

stdout: /var/lib/ambari-agent/data/output-1448.txt

2017-09-14 08:20:38,717 - Stack Feature Version Info: stack_version=2.5, version=None, current_cluster_version=None -> 2.5

2017-09-14 08:20:38,722 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf

User Group mapping (user_group) is missing in the hostLevelParams

2017-09-14 08:20:38,723 - Group['livy'] {}

2017-09-14 08:20:38,724 - Group['spark'] {}

2017-09-14 08:20:38,724 - Group['hadoop'] {}

2017-09-14 08:20:38,724 - Group['users'] {}

2017-09-14 08:20:38,724 - User['hive'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,725 - User['livy'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,726 - User['zookeeper'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,726 - User['spark'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,726 - User['ams'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,727 - User['ambari-qa'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}

2017-09-14 08:20:38,727 - User['tez'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'users']}

2017-09-14 08:20:38,728 - User['hdfs'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,728 - User['yarn'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,729 - User['hcat'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,729 - User['mapred'] {'gid': 'hadoop', 'fetch_nonlocal_groups': True, 'groups': [u'hadoop']}

2017-09-14 08:20:38,730 - File['/var/lib/ambari-agent/tmp/changeUid.sh'] {'content': StaticFile('changeToSecureUid.sh'), 'mode': 0555}

2017-09-14 08:20:38,731 - Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] {'not_if': '(test $(id -u ambari-qa) -gt 1000) || (false)'}

2017-09-14 08:20:38,791 - Skipping Execute['/var/lib/ambari-agent/tmp/changeUid.sh ambari-qa /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa'] due to not_if

2017-09-14 08:20:38,791 - Group['hdfs'] {}

2017-09-14 08:20:38,791 - User['hdfs'] {'fetch_nonlocal_groups': True, 'groups': [u'hadoop', u'hdfs']}

2017-09-14 08:20:38,792 - FS Type:

2017-09-14 08:20:38,792 - Directory['/etc/hadoop'] {'mode': 0755}

2017-09-14 08:20:38,801 - File['/usr/hdp/current/hadoop-client/conf/hadoop-env.sh'] {'content': InlineTemplate(...), 'owner': 'hdfs', 'group': 'hadoop'}

2017-09-14 08:20:38,802 - Directory['/var/lib/ambari-agent/tmp/hadoop_java_io_tmpdir'] {'owner': 'hdfs', 'group': 'hadoop', 'mode': 01777}

2017-09-14 08:20:38,813 - Initializing 2 repositories

2017-09-14 08:20:38,814 - Repository['HDP-2.5'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.6.0/hdp.repo', 'action': ['create'], 'components': [u'HDP', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP', 'mirror_list': None}

2017-09-14 08:20:38,820 - Flushing package manager cache since repo file content is about to change

2017-09-14 08:20:38,820 - checked_call[['zypper', 'clean', '--all']] {'sudo': True}

2017-09-14 08:20:38,967 - checked_call returned (0, 'All repositories have been cleaned up.')

2017-09-14 08:20:38,968 - File['/etc/zypp/repos.d/HDP.repo'] {'content': '[HDP-2.5]\nname=HDP-2.5\nbaseurl=http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.6.0/hdp.repo\n\npath=/\nenabled=1\ngpgcheck=0'}

2017-09-14 08:20:38,968 - Writing File['/etc/zypp/repos.d/HDP.repo'] because contents don't match

2017-09-14 08:20:38,968 - Repository['HDP-UTILS-1.1.0.21'] {'base_url': 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12', 'action': ['create'], 'components': [u'HDP-UTILS', 'main'], 'repo_template': '[{{repo_id}}]\nname={{repo_id}}\n{% if mirror_list %}mirrorlist={{mirror_list}}{% else %}baseurl={{base_url}}{% endif %}\n\npath=/\nenabled=1\ngpgcheck=0', 'repo_file_name': 'HDP-UTILS', 'mirror_list': None}

2017-09-14 08:20:38,972 - Flushing package manager cache since repo file content is about to change

2017-09-14 08:20:38,972 - checked_call[['zypper', 'clean', '--all']] {'sudo': True}

2017-09-14 08:20:39,464 - checked_call returned (0, 'All repositories have been cleaned up.')

2017-09-14 08:20:39,465 - File['/etc/zypp/repos.d/HDP-UTILS.repo'] {'content': '[HDP-UTILS-1.1.0.21]\nname=HDP-UTILS-1.1.0.21\nbaseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12\n\npath=/\nenabled=1\ngpgcheck=0'}

2017-09-14 08:20:39,465 - Writing File['/etc/zypp/repos.d/HDP-UTILS.repo'] because contents don't match

2017-09-14 08:20:39,465 - Package['unzip'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:40,002 - Skipping installation of existing package unzip

2017-09-14 08:20:40,003 - Package['curl'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:40,402 - Skipping installation of existing package curl

2017-09-14 08:20:40,403 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:40,657 - Skipping installation of existing package hdp-select

2017-09-14 08:20:40,884 - Using hadoop conf dir: /usr/hdp/current/hadoop-client/conf

2017-09-14 08:20:40,894 - call['ambari-python-wrap /usr/bin/hdp-select status hive-server2'] {'timeout': 20}

2017-09-14 08:20:40,966 - call returned (0, 'hive-server2 - 2.5.0.0-1245')

2017-09-14 08:20:40,966 - Stack Feature Version Info: stack_version=2.5, version=None, current_cluster_version=None -> 2.5

2017-09-14 08:20:40,989 - Package['hive_2_5_0_0_1245'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:41,399 - Skipping installation of existing package hive_2_5_0_0_1245

2017-09-14 08:20:41,401 - Package['hive_2_5_0_0_1245-hcatalog'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:41,501 - Skipping installation of existing package hive_2_5_0_0_1245-hcatalog

2017-09-14 08:20:41,503 - Package['hive_2_5_0_0_1245-webhcat'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:41,978 - Skipping installation of existing package hive_2_5_0_0_1245-webhcat

2017-09-14 08:20:41,980 - Package['hive2_2_5_0_0_1245'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:42,233 - Skipping installation of existing package hive2_2_5_0_0_1245

2017-09-14 08:20:42,234 - Package['tez_hive2_2_5_0_0_1245'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:42,292 - Skipping installation of existing package tez_hive2_2_5_0_0_1245

2017-09-14 08:20:42,293 - Package['mysql-client'] {'retry_on_repo_unavailability': False, 'retry_count': 5}

2017-09-14 08:20:42,905 - Installing package mysql-client ('/usr/bin/zypper --quiet install --auto-agree-with-licenses --no-confirm mysql-client')

2017-09-14 08:22:48,830 - Execution of '/usr/bin/zypper --quiet install --auto-agree-with-licenses --no-confirm mysql-client' returned 106. Download (curl) error for 'http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.6.0/hdp.repo/repodata/repomd.xml':

Error code: Connection failed

Error message: Failed to connect to public-repo-1.hortonworks.com port 80: Connection timed out

Abort, retry, ignore? [a/r/i/...? shows all options] (a): a

Error building the cache:

[HDP-2.5|http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.6.0/hdp.repo] Valid metadata not found at specified URL

Warning: Skipping repository 'HDP-2.5' because of the above error.

Download (curl) error for 'http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12/repodata/repomd.xml':

Error code: Connection failed

Error message: Failed to connect to public-repo-1.hortonworks.com port 80: Connection timed out

Abort, retry, ignore? [a/r/i/...? shows all options] (a): a

Error building the cache:

[HDP-UTILS-1.1.0.21|http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12] Valid metadata not found at specified URL

Warning: Skipping repository 'HDP-UTILS-1.1.0.21' because of the above error.

File 'repomd.xml' from repository 'saprepo' is unsigned, continue? [yes/no] (no): no

Error building the cache:

[saprepo|http://ls0110.wdf.sap.corp:8080/pub/linux/suse/x86_64/saprepo/SLES-12/] Valid metadata not found at specified URL

Warning: Skipping repository 'saprepo' because of the above error.

Some of the repositories have not been refreshed because of an error.

2017-09-14 08:22:48,830 - Failed to install package mysql-client. Executing '/usr/bin/zypper clean'

2017-09-14 08:22:48,923 - Retrying to install package mysql-client after 30 seconds

Command failed after 1 tries

8 REPLIES 8
Highlighted

Re: Issue in Hive client and Hcat client installation

Super Mentor

@Rishabh Khandelwal

Your error seems to be related to downloading the "repomd.xml"

[HDP-UTILS-1.1.0.21|http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12] Valid metadata not found at specified URL
     Warning: Skipping repository 'HDP-UTILS-1.1.0.21' because of the above error.
     File 'repomd.xml' from repository 'saprepo' is unsigned, continue? [yes/no] (no): no
     Error building the cache:

The issue might be related to the GPE Key related. Please see

https://community.hortonworks.com/articles/73403/unable-to-install-packages-during-upgrade-file-rep....

.

Also please check if you are able to download the following file from the host where the Installation is failing? (i guess you should be able to do it without issues). As the issue seems to be related to GPE Key specific

# wget  http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12/repodata/repomd.xml

.

.

Highlighted

Re: Issue in Hive client and Hcat client installation

New Contributor

Hi Jay SenSharma,

I was trying to install but during the installation process there is an error .

permission denied to repodata.xml from server rather i have the key still showing the same error .

so it there any issue from your repo server

2017-09-20 11:06:56,191 - Execution of '/usr/bin/zypper --quiet install --auto-agree-with-licenses --no-confirm mysql-client' returned 106. Permission to access 'http://public-repo-1.hortonworks.com/HDP/sles12/2.x/updates/2.5.6.0/hdp.repo/repodata/repomd.xml' denied.
Highlighted

Re: Issue in Hive client and Hcat client installation

Super Mentor
Highlighted

Re: Issue in Hive client and Hcat client installation

New Contributor

Hi Jay SenSharma

In our system repos are creating as below in /etc/zypp/repos.d.

-rw-r----- 1 root root 176 Sep 20 11:06 HDP-UTILS.repo

-rw-r----- 1 root root 165 Sep 18 13:49 HDP-UTILS.repo-bakp

-rw-r----- 1 root root 176 Sep 18 14:07 HDP-UTILS.repo~

-rw-r----- 1 root root 136 Sep 18 14:21 HDP.repo

-rw-r----- 1 root root 151 Sep 18 13:50 HDP.repo-bkp

-rw-r----- 1 root root 136 Sep 18 14:00 HDP.repo~

-rw-r--r-- 1 d031543 audio 160 Jul 20 10:39 SAPREPO.repo

-rw-r--r-- 1 d031543 audio 1636 Sep 16 10:00 SLES12-SP2.repo

-rw-r----- 1 root root 591 Sep 18 14:07 hdp.repo

When we run cluster wizard its picking from these repo only.

Can you please let us know how we can get correct repo.

Regards

Ankit

Highlighted

Re: Issue in Hive client and Hcat client installation

Super Mentor

@Rishabh Khandelwal

Based on your previous output:

Error building the cache:

[saprepo|http://ls0110.wdf.sap.corp:8080/pub/linux/suse/x86_64/saprepo/SLES-12/] Valid metadata not found at specified URL

You need may to check your "SAPREPO.repo" repo first.

Highlighted

Re: Issue in Hive client and Hcat client installation

New Contributor
@Jay SenSharma

Below is the details of SAPREPO.repo

/etc/zypp/repos.d # cat SAPREPO.repo

[saprepo]

name=saprepo

enabled=1 autorefresh=0

baseurl=http://ls0110.wdf.sap.corp:8080/pub/linux/suse/x86_64/saprepo/SLES-12/

path=/

type=rpm-md

keeppackages=0

Highlighted

Re: Issue in Hive client and Hcat client installation

Super Mentor
@Rishabh Khandelwal

The following error indicates "saprepo" might be defnined in some other file as well.

[HDP-UTILS-1.1.0.21|http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/sles12] Valid metadata not found at specified URL Warning: Skipping repository 'HDP-UTILS-1.1.0.21' because of the above error.

File 'repomd.xml' from repository 'saprepo' is unsigned, continue? [yes/no] (no): no

Highlighted

Re: Issue in Hive client and Hcat client installation

New Contributor

@Jay SenSharma Please let me know which other files need to be checked for saprepo. Is there any other path to check appart from this /etc/zypp/repos.d

Don't have an account?
Coming from Hortonworks? Activate your account here