Member since
02-02-2021
116
Posts
2
Kudos Received
5
Solutions
My Accepted Solutions
| Title | Views | Posted |
|---|---|---|
| 1315 | 08-13-2021 09:44 AM | |
| 5998 | 04-27-2021 04:23 PM | |
| 2351 | 04-26-2021 10:47 AM | |
| 1536 | 03-29-2021 06:01 PM | |
| 4214 | 03-17-2021 04:53 PM |
04-27-2021
07:42 AM
@vidanimegh Thanks for the response. However, I was able to install other components of hadoop such as zookeeper, hdfs, yarn, mapreduce using the bigtop mpack via ambari. Also earlier ambari was doing a yum install hcatalog which it could not find the package. But I modified the file "/var/lib/ambari-server/resources/common-services/HIVE/0.12.0.2.0/metainfo.xml" so that it did a yum install hive-hcatalog. If I modify that file again to ignore these packages, I am able to successfully install hive metastore and successfully accessed the hive database, however, am having issues starting hiveserver2 and webhcat as it seems to be looking for those files.
... View more
04-27-2021
06:25 AM
@vidanimegh Thanks for the response. Please find the below info... [root@test ~]# yum list webhcat-tar-hive* Loaded plugins: fastestmirror, rhnplugin This system is receiving updates from RHN Classic or Red Hat Satellite. Loading mirror speeds from cached hostfile * base: bay.uchicago.edu * epel: dl.fedoraproject.org * extras: mirror.mobap.edu * updates: ftp.ussg.iu.edu Error: No matching Packages to list [root@test ~]# cat /etc/yum.repos.d/bigtop.repo [bigtop] name=Bigtop enabled=1 gpgcheck=1 baseurl=http://repos.bigtop.apache.org/releases/1.5.0/centos/7/$basearch gpgkey=https://dist.apache.org/repos/dist/release/bigtop/KEYS [root@test ~]# cat /etc/yum.repos.d/BGTP.repo [BGTP-1.0] name=BGTP-1.0 baseurl=http://repos.bigtop.apache.org/releases/1.5.0/centos/7/x86_64/ path=/ enabled=1 gpgcheck=0[root@test ~]#
... View more
04-26-2021
05:24 PM
Hi experts, I am trying to install hive using ambari which i downloaded the bigtop repo. Here is the error: Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 79, in <module>
HCatClient().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 375, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 35, in install
self.install_packages(env)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 821, in install_packages
retry_count=agent_stack_retry_count)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 53, in action_install
self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 264, in install_package
self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 266, in checked_call_with_retries
return self._call_with_retries(cmd, is_checked=True, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 283, in _call_with_retries
code, out = func(cmd, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install webhcat-tar-hive' returned 1. Error: Nothing to do Any help is very much appreciated. Thanks,
... View more
Labels:
04-26-2021
10:47 AM
ok so I finally figured out how to have ambari run the command /usr/bin/yum -d 0 -e 0 -y install hive-hcatalog I had to modify the file: /var/lib/ambari-server/resources/common-services/HIVE/0.12.0.2.0/metainfo.xml under the <osSpecifics> tag. Restarted ambari and then ambari was able to run the correct command to have hive installed.
... View more
04-23-2021
09:14 AM
@Scharan Ambari Version 2.6.1.0 Here is the error I see in ambari when it is trying to install the components. Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 79, in <module>
HCatClient().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 375, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 35, in install
self.install_packages(env)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 821, in install_packages
retry_count=agent_stack_retry_count)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 53, in action_install
self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 264, in install_package
self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 266, in checked_call_with_retries
return self._call_with_retries(cmd, is_checked=True, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 283, in _call_with_retries
code, out = func(cmd, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install hcatalog' returned 1. Error: Nothing to do
... View more
04-22-2021
05:43 PM
Hi experts, I am trying to deploy a cluster with the apache bigtops package via ambari. I was able to deploy the basic components such as hdfs, yarn, mapreduce, and zookeeper via ambari. Now I am trying to install hive. I am able to install hive through the command line with "yum install hive*" Ambari is currently failing to install hcatalog. Looking at the ambari logs, I noticed this error: resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install hcatalog' returned 1. Error: Nothing to do However, when installing via command line, I am able to install hcatalog with "yum install hive-hcatalog" Can someone please let me know how I can have ambari run the command /usr/bin/yum -d 0 -e 0 -y install hive-hcatalog instead of /usr/bin/yum -d 0 -e 0 -y install hcatalog Any help is much appreciated. Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
03-29-2021
06:01 PM
ok sorry I just found the issue. Noticed the LLAP daemons were being run by the user hive whereas the AMs were being run by the user root. Now I have the AM and the daemons both being run by hive and now the Hive LLAP UI is being updated and working.
... View more
03-29-2021
05:51 PM
Hi experts, When I start hive LLAP, it seems to be working as I am able to access databases and tables via LLAP. However, the hive LLAP UI "state = completed". Also shows the wrong information such as the App id or does not even show any llap daemons running. I can clearly see that the AM and LLAP daemon is running. { "amInfo" : { "appName" : "llap_service", "appType" : "org-apache-slider", "appId" : "application_1616963398366_0079", "containerId" : "container_e59_1616963398366_0079_01_000001", "hostname" : "test04.domain.com", "amWebUrl" : "http://test04.domain.com:44972/" }, "state" : "RUNNING_ALL", "originalConfigurationPath" : "hdfs://test/user/hive/.slider/cluster/llap_service/snapshot", "generatedConfigurationPath" : "hdfs://test/user/hive/.slider/cluster/llap_service/generated", "desiredInstances" : 1, "liveInstances" : 1, "launchingInstances" : 0, "appStartTime" : 1617064445107, "runningThresholdAchieved" : true, "runningInstances" : [ { "hostname" : "test03.domain.com", "containerId" : "container_e59_1616963398366_0079_01_000002", "logUrl" : "http://test03.domain.com:8042/node/containerlogs/container_e59_1616963398366_0079_01_000002/hive", "statusUrl" : "http://test03.domain.com:15002/status", "webUrl" : "http://test03.domain.com:15002", "rpcPort" : 45767, "mgmtPort" : 15004, "shufflePort" : 15551, "yarnContainerExitStatus" : 0 } ] } Any help is much appreciated. Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
03-25-2021
02:25 PM
Hi experts, I was wondering if there is a place where it shows the enhancements between each hadoop component such as hadoop, yarn, hive, hbase, etc. So I am trying to find a reason to upgrade our hadoop clusters or wait for a newer version to come out. Any help is much appreciated. Thanks,
... View more
03-25-2021
09:05 AM
Thanks @Daming Xue for the response. So i tried installing Hive 2.2 and it worked. Do you know how I can test hive LLAP vs regular hiveserver2 to see the difference? Any good hiveserver2 queries or something so I can test the LLAP setup vs hiveserver2? Thanks,
... View more