HDF 2.1 Install fails on Centos 7

[#1]

Traceback (most recent call last):

  File "/var/lib/ambari-agent/cache/stacks/HDF/2.0/hooks/before-INSTALL/scripts/hook.py", line 37, in <module>
    BeforeInstallHook().execute()
  File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute
    method(env)
  File "/var/lib/ambari-agent/cache/stacks/HDF/2.0/hooks/before-INSTALL/scripts/hook.py", line 34, in hook
    install_packages()
  File "/var/lib/ambari-agent/cache/stacks/HDF/2.0/hooks/before-INSTALL/scripts/shared_initialization.py", line 37, in install_packages
    retry_count=params.agent_stack_retry_count)
  File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__
    self.env.run()
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
    self.run_action(resource, action)
  File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
    provider_action()
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install
    self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package
    self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 83, in checked_call_with_retries
    return self._call_with_retries(cmd, is_checked=True, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 91, in _call_with_retries
    code, out = func(cmd, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 71, in inner
    result = function(command, **kwargs)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 93, in checked_call
    tries=tries, try_sleep=try_sleep)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 141, in _call_wrapper
    result = _call(command, **kwargs_copy)
  File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call
    raise Fail(err_msg)
resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install hdf-select' returned 1. Transaction check error:
  file /usr/bin/conf-select from install of hdf-select-2.0.2.0-17.el6.noarch conflicts with file from package hdp-select-2.5.0.0-1245.el6.noarch

Error Summary

[#2]

@Timothy Spann

It is strange to see the "el6.noarch" package extension for CentOS 7 operating system. For CentOS7 usually the package extension should be something like "el7.noarch".

Are the repositories URLs pointing to the correct repo?

[#3]

Everything is el7 not sure what is up with the el6

[#4]

@Timothy Spann

HDF 2.1 repos for centos7 as listed here:

http://docs.hortonworks.com/HDPDocuments/HDF2/HDF-2.1.0/bk_dataflow-release-notes/content/ch_hdf_rel...

[#5 · Accepted solution]

@Constantin Stanca suggested I take a look at the repos

[root@tspanndev13 .ssh]# yum repolist
Loaded plugins: fastestmirror
Repository HDP-UTILS-1.1.0.21 is listed more than once in the configuration
Loading mirror speeds from cached hostfile
 * base: denver.gaminghost.co
 * epel: mirror.sfo12.us.leaseweb.net
 * extras: mirror.sjc02.svwh.net
 * updates: mirror.keystealth.org
repo id                                                                                  repo name                                                                                                    status
HDF-2.0                                                                                  HDF-2.0                                                                                                          39
HDF-2.1.0.0                                                                              HDF Version - HDF-2.1.0.0                                                                                        41
HDP-2.5                                                                                  HDP-2.5                                                                                                         200
HDP-UTILS-1.1.0.21                                                                       HDP-UTILS-1.1.0.21                                                                                               52
!Updates-ambari-2.4.2.0                                                                  ambari-2.4.2.0 - Updates                                                                                         12
base/7/x86_64                                                                            CentOS-7 - Base                                                                                               9,363
cuda                                                                                     cuda                                                                                                            173
draios/x86_64                                                                            Draios                                                                                                           16
epel/x86_64                                                                              Extra Packages for Enterprise Linux 7 - x86_64                                                               10,955
epel-apache-maven/7/x86_64                                                               maven from apache foundation.                                                                                     3
extras/7/x86_64                                                                          CentOS-7 - Extras                                                                                               435
home_oojah_mqtt                                                                          mqtt (CentOS_CentOS-7)                                                                                            8
updates/7/x86_64                                                                         CentOS-7 - Updates                                                                                              399
repolist: 21,696

Seems I have a few extra in there to delete. That fixed it.

[#6]

Hi @Timothy Spann

can you help solve this issue?

When I tried install HDF 2.0 with ambari. I got following error, it seems like the version of srorm in HDF repo is not matched with install script. did anyone get it?

p.p1 {margin: 0.0px 0.0px 0.0px 0.0px; font: 11.0px Courier; color: #333333; -webkit-text-stroke: #333333; background-color: #f5f5f5} span.s1 {font-kerning: none}

Traceback (most recent call last):

File "/var/lib/ambari-agent/cache/common-services/STORM/0.9.1/package/scripts/drpc_server.py", line 139, in <module>

DrpcServer().execute()

File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 280, in execute

method(env)

File "/var/lib/ambari-agent/cache/common-services/STORM/0.9.1/package/scripts/drpc_server.py", line 43, in install

self.install_packages(env)

File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 567, in install_packages

retry_count=agent_stack_retry_count)

File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 155, in __init__

self.env.run()

File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run

self.run_action(resource, action)

File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action

provider_action()

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 54, in action_install

self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 49, in install_package

self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 83, in checked_call_with_retries

return self._call_with_retries(cmd, is_checked=True, **kwargs)

File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 91, in _call_with_retries

code, out = func(cmd, **kwargs)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 71, in inner

result = function(command, **kwargs)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 93, in checked_call

tries=tries, try_sleep=try_sleep)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 141, in _call_wrapper

result = _call(command, **kwargs_copy)

File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 294, in _call

raise Fail(err_msg)

resource_management.core.exceptions.Fail: Execution of '/usr/bin/yum -d 0 -e 0 -y install storm_2_1_2_0_10' returned 1. Error: Nothing to do

[root@ochadoop07 /]# yum list | grep storm

ranger-storm-plugin.noarch 0.6.0.2.0.2.0-17.el6 HDF-2.0

ranger_2_0_2_0_17-storm-plugin.x86_64 0.6.0.2.0.2.0-17.el6 HDF-2.0

storm.noarch 1.0.1.2.0.2.0-17.el6 HDF-2.0

storm-slider-client.noarch 1.0.1.2.0.2.0-17.el6 HDF-2.0

storm_2_0_2_0_17.x86_64 1.0.1.2.0.2.0-17.el6 HDF-2.0

storm_2_0_2_0_17-slider-client.x86_64 1.0.1.2.0.2.0-17.el6 HDF-2.0