Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

Highlighted

While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

We are using local repository in our cluster as we do not have outbound internet connection. We also do not have sufficient space in the /var/www/html folder to store all the installation files. So we created symbolic link in the /var/www/html folder to the local repository.While deploying the services in the cluster from ambari ui , it is failing.

Initially the base-url in the repo file was not populated automatically. So we follow the steps mentioned in the below page:- https://community.hortonworks.com/articles/231020/ambari-273-ambari-writes-empty-baseurl-values-writ...

Still the installation is failing in the step 9 of the installation from ambari UI. Please help us to resolve this issue. Please find the failure log below. The log is also attached in the below file also:-


ErrorAmbari.txt


The failure log message is:-

raise RuntimeError(message) RuntimeError: Failed to execute command '/usr/bin/yum -y install ambari-metrics-monitor', exited with code '1', message: 'warning: /var/cache/yum/x86_64/7Server/ambari-2.7.3.0/packages/ambari-metrics-monitor-2.7.3.0-139.x86_64.rpm: Header V4 RSA/SHA1 Signature, key ID 07513cad: NOKEY 

 

GPG key retrieval failed: [Errno 14] HTTP Error 404 - Not Found
11 REPLIES 11

Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

The screenshot of the failure:-


109253-1559645318978.png

Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

Super Mentor

@Pritam Konar

As we see the error like following error while installing the ambari-metrics-monitor package.

  1. GPG key retrieval failed: [Errno 14] HTTP Error 404 - Not Found


So looks like your /etc/yum.repos.d/ambari.repo file on that host might not be correct or the ambari REPO url might not be accessible from that host.


Also from the failing host can you please verify if the Ambari Repo is accessible or not?

 # curl -iv http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.7.3.0/repodata/repomd.xml


Also please check if you are able to download the GPG key from failing host?

# cat /etc/yum.repos.d/ambari.repo | grep gpgkey
gpgkey=http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.7.3.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins


#  curl -o /tmp/RPM-GPG-KEY-Jenkins http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.7.3.0/RPM-GPG-KEY/RPM-GPG-KEY-Jenk...; cat /tmp/RPM-GPG-KEY-Jenkins

.


Have you setup any Network proxy on the failing host?

# cat /etc/yum.conf | grep -i proxy
# cat ~/.bash_profile | grep -i proxy
# cat /etc/profile | grep -i proxy
# env | grep -i proxy


.

Please try to perform a yum clean all on the failing host.

# yum clean all

So please check the "/etc/yum.repos.d" directory on the failing host when the installation failed. Remove any unwanted repos from that directory.


Just for testing , temporarily just move all other repos from that directory except the ambari and hdp repo files and then perform the yum cleanup

# yum clean all
# yum install ambari-metrics-monitor -y

and then click on the retry button in the ambari UI.


If it still fails to install then please check and share the "/var/log/yum.log" file from the failing host.

Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

Please find the yum log here attached:-


YumLog.txt

Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

Community Manager

The above question and the reply thread below was originally posted in the Community Help Track. On Tue Jun 4 13:35 UTC 2019, a member of the HCC moderation staff moved it to the Cloud & Operations track. The Community Help Track is intended for questions about using the HCC site itself.

Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

@Jay Kumar SenSharma Please find the output below:-

From failing host:-


[root@nlddfmrvu11 yum.repos.d]# curl -iv http://nladfmrvu11:20001/ambari/centos7/2.7.3.0-139/updates/2.7.3.0/repodata/repomd.xml

* About to connect() to nladfmrvu11 port 20001 (#0)

* Trying 10.244.8.52...

* Connected to nladfmrvu11 (10.244.8.52) port 20001 (#0)

> GET /ambari/centos7/2.7.3.0-139/updates/2.7.3.0/repodata/repomd.xml HTTP/1.1

> User-Agent: curl/7.29.0

> Host: nladfmrvu11:20001

> Accept: */*

>

< HTTP/1.1 404 Not Found

HTTP/1.1 404 Not Found

< Date: Tue, 04 Jun 2019 13:53:08 GMT

Date: Tue, 04 Jun 2019 13:53:08 GMT

< Server: Apache/2.4.6 (Red Hat Enterprise Linux)

Server: Apache/2.4.6 (Red Hat Enterprise Linux)

< Content-Length: 260

Content-Length: 260

< Content-Type: text/html; charset=iso-8859-1

Content-Type: text/html; charset=iso-8859-1


<

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">

<html><head>

<title>404 Not Found</title>

</head><body>

<h1>Not Found</h1>

<p>The requested URL /ambari/centos7/2.7.3.0-139/updates/2.7.3.0/repodata/repomd.xml was not found on this server.</p>

</body></html>

* Connection #0 to host nladfmrvu11 left intact

[root@nlddfmrvu11 yum.repos.d]#


From failing host, i am able to download the GPG Key :-


[root@nlddfmrvu11 yum.repos.d]#

[root@nlddfmrvu11 yum.repos.d]# cat /etc/yum.repos.d/ambari.repo | grep gpgkey

gpgkey=http://nladfmrvu11:20001/ambari/centos7/2.7.3.0-139/RPM-GPG-KEY/RPM-GPG-Jenkins

[root@nlddfmrvu11 yum.repos.d]#

[root@nlddfmrvu11 yum.repos.d]#

[root@nlddfmrvu11 yum.repos.d]# curl -o /tmp/RPM-GPG-KEY-Jenkins http://nladfmrvu11:20001/ambari/centos7/2.7.3.0-139/RPM-GPG-KEY/RPM-GPG-Jenkins;

% Total % Received % Xferd Average Speed Time Time Time Current

Dload Upload Total Spent Left Speed

100 252 100 252 0 0 24258 0 --:--:-- --:--:-- --:--:-- 28000

[root@nlddfmrvu11 yum.repos.d]#

[root@nlddfmrvu11 yum.repos.d]#

[root@nlddfmrvu11 yum.repos.d]# cat /tmp/RPM-GPG-KEY-Jenkins

<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">

<html><head>

<title>404 Not Found</title>

</head><body>

<h1>Not Found</h1>

<p>The requested URL /ambari/centos7/2.7.3.0-139/RPM-GPG-KEY/RPM-GPG-Jenkins was not found on this server.</p>

</body></html>

[root@nlddfmrvu11 yum.repos.d]#



Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

Regarding proxy settings, we have not done any changes in the failing host:-

[root@nlddfmrvu11 ~]#

[root@nlddfmrvu11 ~]#

[root@nlddfmrvu11 ~]# cat /etc/yum.conf | grep -i proxy

[root@nlddfmrvu11 ~]# cat ~/.bash_profile | grep -i proxy

[root@nlddfmrvu11 ~]#

[root@nlddfmrvu11 ~]# cat /etc/profile | grep -i proxy

[root@nlddfmrvu11 ~]#

[root@nlddfmrvu11 ~]# env | grep -i proxy

[root@nlddfmrvu11 ~]#

[root@nlddfmrvu11 ~]#

Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

We cleaned up all the repo files from the location /etc/yum.repo.d location:-


[root@nlddfmrvu11 yum.repos.d]# ll

total 12

-rw-r--r--. 1 edtuser hadoop 333 Jun 4 15:51 ambari.repo

-rw-r--r--. 1 root root 6252 Jan 4 00:29 redhat.repo

[root@nlddfmrvu11 yum.repos.d]#

[root@nlddfmrvu11 yum.repos.d]#

[root@nlddfmrvu11 yum.repos.d]# pwd

/etc/yum.repos.d

[root@nlddfmrvu11 yum.repos.d]#



[root@nlddfmrvu11 yum.repos.d]#

[root@nlddfmrvu11 yum.repos.d]# yum clean all

Loaded plugins: enabled_repos_upload, langpacks, package_upload, product-id, search-disabled-repos, subscription-manager

Cleaning repos: Mobile_Telephone_Networks_S_A__EPEL_EPEL_7_-_x86_64 Mobile_Telephone_Networks_S_A__Xymon_Xymon_EL_7_-_x86_64 ambari-2.7.3.0 rhel-7-server-extras-rpms

: rhel-7-server-insights-3-rpms rhel-7-server-optional-rpms rhel-7-server-rpms rhel-7-server-satellite-tools-6.3-rpms rhel-7-server-supplementary-rpms

: rhel-7-server-thirdparty-oracle-java-rpms rhel-server-rhscl-7-rpms

Other repos take up 329 M of disk space (use --verbose for details)

Uploading Enabled Repositories Report

Loaded plugins: langpacks, product-id, subscription-manager

[root@nlddfmrvu11 yum.repos.d]# ll

total 12

-rw-r--r--. 1 edtuser hadoop 333 Jun 4 15:51 ambari.repo

-rw-r--r--. 1 root root 6252 Jan 4 00:29 redhat.repo

[root@nlddfmrvu11 yum.repos.d]#




Again error is coming while installing in the failing host:-


[root@nlddfmrvu11 yum.repos.d]# yum install ambari-metrics-monitor -y

Loaded plugins: enabled_repos_upload, langpacks, package_upload, product-id, search-disabled-repos, subscription-manager

Mobile_Telephone_Networks_S_A__EPEL_EPEL_7_-_x86_64 | 2.1 kB 00:00:00

Mobile_Telephone_Networks_S_A__Xymon_Xymon_EL_7_-_x86_64 | 2.1 kB 00:00:00

http://nladfmrvu11:20001/ambari/centos7/2.7.3.0-139/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found

Trying other mirror.

To address this issue please refer to the below knowledge base article


https://access.redhat.com/articles/1320623


If above article doesn't help to resolve this issue please open a ticket with Red Hat Support.




One of the configured repositories failed (ambari Version - ambari-2.7.3.0),

and yum doesn't have enough cached data to continue. At this point the only

safe thing yum can do is fail. There are a few ways to work "fix" this:


1. Contact the upstream for the repository and get them to fix the problem.


2. Reconfigure the baseurl/etc. for the repository, to point to a working

upstream. This is most often useful if you are using a newer

distribution release than is supported by the repository (and the

packages for the previous distribution release still work).


3. Run the command with the repository temporarily disabled

yum --disablerepo=ambari-2.7.3.0 ...


4. Disable the repository permanently, so yum won't use it by default. Yum

will then just ignore the repository until you permanently enable it

again or use --enablerepo for temporary usage:


yum-config-manager --disable ambari-2.7.3.0

or

subscription-manager repos --disable=ambari-2.7.3.0


5. Configure the failing repository to be skipped, if it is unavailable.

Note that yum will try to contact the repo. when it runs most commands,

so will have to try and fail each time (and thus. yum will be be much

slower). If it is a very temporary problem though, this is often a nice

compromise:


yum-config-manager --save --setopt=ambari-2.7.3.0.skip_if_unavailable=true


failure: repodata/repomd.xml from ambari-2.7.3.0: [Errno 256] No more mirrors to try.

http://nladfmrvu11:20001/ambari/centos7/2.7.3.0-139/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found

Uploading Enabled Repositories Report

Loaded plugins: langpacks, product-id, subscription-manager

[root@nlddfmrvu11 yum.repos.d]#


Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

@Jay Kumar SenSharma Please advice.

Re: While installing the services in Hortonworks cluster through Apache Ambari, we are getting the below failure in the log.

Super Mentor

@Pritam Konar

Looks like your Offline Local repositories are not configured properly hence even the CURL command is not able to access the repo info and hence we see the 404 error (means resource not found)

# curl -iv http://nladfmrvu11:20001/ambari/centos7/2.7.3.0-139/updates/2.7.3.0/repodata/repomd.xml
404-Error


# curl -iv  http://nladfmrvu11:20001/ambari/centos7/2.7.3.0-139/RPM-GPG-KEY/RPM-GPG-Jenkins 
404-Error

.

So please do SSH login to the local repository host and then verify if the directory structure of the repo is correct and is accessible or not?

The following doc provides a detailed info on how to configure the local offline repo.

https://docs.hortonworks.com/HDPDocuments/Ambari-2.7.3.0/bk_ambari-installation/content/setting_up_a...


.