HDF 3.3.1 and ambari 2.7.3 instllation failed

[#1]

Hello all,

We are installing 5 nodes HDF cluster using local repository and facing below issue .its seems look like not pointing to right local repo. Can someone please help me .

Thanks in advance .

-Vicky

Cannot find a valid baseurl for repo: HDF-3.3-repo-152

Traceback (most recent call last):
  File "/var/lib/ambari-agent/cache/stack-hooks/before-INSTALL/scripts/hook.py", line 37, in <module>
    BeforeInstallHook().execute()
  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stack-hooks/before-INSTALL/scripts/hook.py", line 33, in hook
    install_packages()
  File "/var/lib/ambari-agent/cache/stack-hooks/before-INSTALL/scripts/shared_initialization.py", line 37, in install_packages
    retry_count=params.agent_stack_retry_count)
  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__
    self.env.run()
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/packaging.py", line 30, in action_install
    self._pkg_manager.install_package(package_name, self.__create_context())
  File "/usr/lib/ambari-agent/lib/ambari_commons/repo_manager/yum_manager.py", line 219, in install_package
    shell.repository_manager_executor(cmd, self.properties, context)
  File "/usr/lib/ambari-agent/lib/ambari_commons/shell.py", line 753, in repository_manager_executor
    raise RuntimeError(message)
RuntimeError: Failed to execute command '/usr/bin/yum -y install hdf-select', exited with code '1', message: 'Repository HDP-UTILS-1.1.0.22 is listed more than once in the configuration
 One of the configured repositories failed (Unknown),

 and yum doesn't have enough cached data to continue. At this point the only

 safe thing yum can do is fail. There are a few ways to work "fix" this:
     1. Contact the upstream for the repository and get them to fix the problem.
     2. Reconfigure the baseurl/etc. for the repository, to point to a working

        upstream. This is most often useful if you are using a newer

        distribution release than is supported by the repository (and the

        packages for the previous distribution release still work).
     3. Run the command with the repository temporarily disabled

            yum --disablerepo=<repoid> ...
     4. Disable the repository permanently, so yum won't use it by default. Yum

        will then just ignore the repository until you permanently enable it

        again or use --enablerepo for temporary usage:
            yum-config-manager --disable <repoid>

        or

            subscription-manager repos --disable=<repoid>
     5. Configure the failing repository to be skipped, if it is unavailable.

        Note that yum will try to contact the repo. when it runs most commands,

        so will have to try and fail each time (and thus. yum will be be much

        slower). If it is a very temporary problem though, this is often a nice

        compromise:
            yum-config-manager --save --setopt=<repoid>.skip_if_unavailable=true
Cannot find a valid baseurl for repo: HDF-3.3-repo-152

[#2 · Accepted solution]

@Vicky Thatavarthi

Can you please share the output of the following Ambari API call on the browser where you have already logging in to Ambari UI?

http://$AMBARI_HOST:8080/api/v1/stacks/HDF/versions/3.1?fields=operating_systems/repositories/Reposi...

Please replace the with your ambari Hostname "AMBARI_HOST" and the HDF version (i am using 3.1) and

In the output of the above API call you will find a JSON response with few "base_url"

Copy the "base_url" based on your Operating System version. Then append the "/repodata/repomd.xml" at the end of your "base_url" and then check if you are able to open that url from ambari server host using CURL command? If the local repo is configured properly and there is no Network / firewall issue then you should see a valid XML file.

Example: (from ambari server host) and also try to open the below mentioned URL in your browser to see if it works and it is valid?

# curl -ivL  http://your.example.localrepo/HDF/centos7/3.x/updates/3.1.0.0/repodata/repomd.xml

Assuming your "base_url" is "http://$YOUR.example.localrepo/HDF/centos7/3.x/updates/3.1.0.0"

.

[#3]

Thanks @Jay Kumar SenSharma for your help.

Please see the output of the Ambari API call on browser . ambari-api-call-on-the-browser-output.txt

http://$HOST_NAME:8080/api/v1/stacks/HDF/versions/3.3?fields=operating_systems/repositories/Reposito...

and CURL command on ambari server host .

curl -ivL http://$HOST_NAME:8080/hdf/HDF/centos7/3.3.1.0-10/repodata/repomd.xml

Please find the attached curl commend response .curl-uri-response.txt

Can you please have a look on output files .

Appreciated your help .

-Vicky