Skip to main content
vicky_thatavart
Silver ⭐️⭐️
January 31, 2019
Solved

HDF 3.3.1 and ambari 2.7.3 instllation failed

Hello all,

We are installing 5 nodes HDF cluster using local repository and facing below issue .its seems look like not pointing to right local repo. Can someone please help me .

Thanks in advance .

-Vicky

Cannot find a valid baseurl for repo: HDF-3.3-repo-152

Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/stack-hooks/before-INSTALL/scripts/hook.py", line 37, in <module>
BeforeInstallHook().execute()
File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
method(env)
File "/var/lib/ambari-agent/cache/stack-hooks/before-INSTALL/scripts/hook.py", line 33, in hook
install_packages()
File "/var/lib/ambari-agent/cache/stack-hooks/before-INSTALL/scripts/shared_initialization.py", line 37, in install_packages
retry_count=params.agent_stack_retry_count)
File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/ambari-agent/lib/resource_management/core/providers/packaging.py", line 30, in action_install
self._pkg_manager.install_package(package_name, self.__create_context())
File "/usr/lib/ambari-agent/lib/ambari_commons/repo_manager/yum_manager.py", line 219, in install_package
shell.repository_manager_executor(cmd, self.properties, context)
File "/usr/lib/ambari-agent/lib/ambari_commons/shell.py", line 753, in repository_manager_executor
raise RuntimeError(message)
RuntimeError: Failed to execute command '/usr/bin/yum -y install hdf-select', exited with code '1', message: 'Repository HDP-UTILS-1.1.0.22 is listed more than once in the configuration
One of the configured repositories failed (Unknown),

and yum doesn't have enough cached data to continue. At this point the only

safe thing yum can do is fail. There are a few ways to work "fix" this:
1. Contact the upstream for the repository and get them to fix the problem.
2. Reconfigure the baseurl/etc. for the repository, to point to a working

upstream. This is most often useful if you are using a newer

distribution release than is supported by the repository (and the

packages for the previous distribution release still work).
3. Run the command with the repository temporarily disabled

yum --disablerepo=<repoid> ...
4. Disable the repository permanently, so yum won't use it by default. Yum

will then just ignore the repository until you permanently enable it

again or use --enablerepo for temporary usage:
yum-config-manager --disable <repoid>

or

subscription-manager repos --disable=<repoid>
5. Configure the failing repository to be skipped, if it is unavailable.

Note that yum will try to contact the repo. when it runs most commands,

so will have to try and fail each time (and thus. yum will be be much

slower). If it is a very temporary problem though, this is often a nice

compromise:
yum-config-manager --save --setopt=<repoid>.skip_if_unavailable=true
Cannot find a valid baseurl for repo: HDF-3.3-repo-152

jsensharma
Platinum ⭐️⭐️
January 31, 2019

@Vicky Thatavarthi

Can you please share the output of the following Ambari API call on the browser where you have already logging in to Ambari UI?

http://$AMBARI_HOST:8080/api/v1/stacks/HDF/versions/3.1?fields=operating_systems/repositories/Repositories


Please replace the with your ambari Hostname "AMBARI_HOST" and the HDF version (i am using 3.1) and

In the output of the above API call you will find a JSON response with few "base_url"

Copy the "base_url" based on your Operating System version. Then append the "/repodata/repomd.xml" at the end of your "base_url" and then check if you are able to open that url from ambari server host using CURL command? If the local repo is configured properly and there is no Network / firewall issue then you should see a valid XML file.

Example: (from ambari server host) and also try to open the below mentioned URL in your browser to see if it works and it is valid?

# curl -ivL http://your.example.localrepo/HDF/centos7/3.x/updates/3.1.0.0/repodata/repomd.xml


Assuming your "base_url" is "http://$YOUR.example.localrepo/HDF/centos7/3.x/updates/3.1.0.0"

.

2 replies

jsensharma
Platinum ⭐️⭐️
Platinum ⭐️⭐️
January 31, 2019

@Vicky Thatavarthi

Can you please share the output of the following Ambari API call on the browser where you have already logging in to Ambari UI?

http://$AMBARI_HOST:8080/api/v1/stacks/HDF/versions/3.1?fields=operating_systems/repositories/Repositories


Please replace the with your ambari Hostname "AMBARI_HOST" and the HDF version (i am using 3.1) and

In the output of the above API call you will find a JSON response with few "base_url"

Copy the "base_url" based on your Operating System version. Then append the "/repodata/repomd.xml" at the end of your "base_url" and then check if you are able to open that url from ambari server host using CURL command? If the local repo is configured properly and there is no Network / firewall issue then you should see a valid XML file.

Example: (from ambari server host) and also try to open the below mentioned URL in your browser to see if it works and it is valid?

# curl -ivL http://your.example.localrepo/HDF/centos7/3.x/updates/3.1.0.0/repodata/repomd.xml


Assuming your "base_url" is "http://$YOUR.example.localrepo/HDF/centos7/3.x/updates/3.1.0.0"

.

Translate
vicky_thatavart
Silver ⭐️⭐️
January 31, 2019

Thanks @Jay Kumar SenSharma for your help.

Please see the output of the Ambari API call on browser . ambari-api-call-on-the-browser-output.txt

http://$HOST_NAME:8080/api/v1/stacks/HDF/versions/3.3?fields=operating_systems/repositories/Repositories

and CURL command on ambari server host .

curl -ivL http://$HOST_NAME:8080/hdf/HDF/centos7/3.3.1.0-10/repodata/repomd.xml

Please find the attached curl commend response .curl-uri-response.txt

Can you please have a look on output files .

Appreciated your help .

-Vicky

Translate