Skip to main content
ryu
ryu
Gold ⭐️
April 27, 2021
Solved

hive installation error via ambari

Hi experts,

I am trying to install hive using ambari which i downloaded the bigtop repo.

 

Here is the error:

Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 79, in <module>
HCatClient().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 375, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 35, in install
self.install_packages(env)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 821, in install_packages
retry_count=agent_stack_retry_count)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 53, in action_install
self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 264, in install_package
self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 266, in checked_call_with_retries
return self._call_with_retries(cmd, is_checked=True, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 283, in _call_with_retries
code, out = func(cmd, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install webhcat-tar-hive' returned 1. Error: Nothing to do

 Any help is very much appreciated.

 

Thanks,

 

ryu
ryuAnswer
Gold ⭐️
April 27, 2021

Here is an update.

So I finally was able to use ambari to get Hive installed and services started using the apache bigtop repo. Also was able to connect via hiveCLI as well as beeline(hiveserver2) and ran a simple "show databases;" which ran successfully.

 

So after symlinking the following directories, hiveserver2 finally was able to start successfully.

 

[root@test ~]# ll /usr/bgtp/current/
total 32
lrwxrwxrwx 1 root root 13 Apr 23 19:38 hive-client -> /usr/lib/hive
lrwxrwxrwx 1 root root 13 Apr 23 19:37 hive-metastore -> /usr/lib/hive
lrwxrwxrwx 1 root root 13 Apr 27 16:28 hive-server2 -> /usr/lib/hive
lrwxrwxrwx 1 root root 22 Apr 27 16:29 hive-webhcat -> /usr/lib/hive-hcatalog

 

I did not find any documentation on how to install hive with the apache bigtop packages using ambari. There was some documentation on how to install hive with the apache bigtop package using the command line.

 

If anyone finds any documentation on how to install the different components in the apache bigtop package, please let me know.

 

Thanks,

View in thread

8 replies

vidanimegh
vidanimegh
Gold ⭐️
April 27, 2021

Hi @ryu ,

 

It seems that your repo is not correctly configured.

 

Can you paste the output of "yum list webhcat-tar-hive*"?

 

Also, share the contents of /etc/yum.repos.d/<your repo file>.repo

 

Thanks,

Megh

Translate
    ryu
    ryuAuthor
    Gold ⭐️
    April 27, 2021

    @vidanimegh  Thanks for the response.

    Please find the below info...

     

    [root@test ~]# yum list webhcat-tar-hive*
    Loaded plugins: fastestmirror, rhnplugin
    This system is receiving updates from RHN Classic or Red Hat Satellite.
    Loading mirror speeds from cached hostfile
    * base: bay.uchicago.edu
    * epel: dl.fedoraproject.org
    * extras: mirror.mobap.edu
    * updates: ftp.ussg.iu.edu
    Error: No matching Packages to list

     

    [root@test ~]# cat /etc/yum.repos.d/bigtop.repo
    [bigtop]
    name=Bigtop
    enabled=1
    gpgcheck=1
    baseurl=http://repos.bigtop.apache.org/releases/1.5.0/centos/7/$basearch
    gpgkey=https://dist.apache.org/repos/dist/release/bigtop/KEYS
    [root@test ~]# cat /etc/yum.repos.d/BGTP.repo
    [BGTP-1.0]
    name=BGTP-1.0
    baseurl=http://repos.bigtop.apache.org/releases/1.5.0/centos/7/x86_64/

    path=/
    enabled=1
    gpgcheck=0[root@test ~]#

     

    Translate
    ryu
    ryuAuthor
    Gold ⭐️
    April 27, 2021

    @vidanimegh 

    Thanks for the response.

    However, I was able to install other components of hadoop such as zookeeper, hdfs, yarn, mapreduce using the bigtop mpack via ambari.

     

    Also earlier ambari was doing a yum install hcatalog which it could not find the package.

    But I modified the file "/var/lib/ambari-server/resources/common-services/HIVE/0.12.0.2.0/metainfo.xml" so that it did a yum install hive-hcatalog.

     

    If I modify that file again to ignore these packages, I am able to successfully install hive metastore and successfully accessed the hive database, however, am having issues starting hiveserver2 and webhcat as it seems to be looking for those files.

    Translate
    Terms & ConditionsAccessibility statement