Member since
02-02-2021
116
Posts
2
Kudos Received
5
Solutions
My Accepted Solutions
Title | Views | Posted |
---|---|---|
747 | 08-13-2021 09:44 AM | |
3712 | 04-27-2021 04:23 PM | |
1389 | 04-26-2021 10:47 AM | |
927 | 03-29-2021 06:01 PM | |
2761 | 03-17-2021 04:53 PM |
04-23-2021
09:14 AM
@Scharan Ambari Version 2.6.1.0 Here is the error I see in ambari when it is trying to install the components. Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 79, in <module>
HCatClient().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 375, in execute
method(env)
File "/var/lib/ambari-agent/cache/common-services/HIVE/0.12.0.2.0/package/scripts/hcat_client.py", line 35, in install
self.install_packages(env)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 821, in install_packages
retry_count=agent_stack_retry_count)
File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 166, in __init__
self.env.run()
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 160, in run
self.run_action(resource, action)
File "/usr/lib/python2.6/site-packages/resource_management/core/environment.py", line 124, in run_action
provider_action()
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 53, in action_install
self.install_package(package_name, self.resource.use_repos, self.resource.skip_repos)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/yumrpm.py", line 264, in install_package
self.checked_call_with_retries(cmd, sudo=True, logoutput=self.get_logoutput())
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 266, in checked_call_with_retries
return self._call_with_retries(cmd, is_checked=True, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/providers/package/__init__.py", line 283, in _call_with_retries
code, out = func(cmd, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 72, in inner
result = function(command, **kwargs)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 102, in checked_call
tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 150, in _call_wrapper
result = _call(command, **kwargs_copy)
File "/usr/lib/python2.6/site-packages/resource_management/core/shell.py", line 303, in _call
raise ExecutionFailed(err_msg, code, out, err)
resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install hcatalog' returned 1. Error: Nothing to do
... View more
04-22-2021
05:43 PM
Hi experts, I am trying to deploy a cluster with the apache bigtops package via ambari. I was able to deploy the basic components such as hdfs, yarn, mapreduce, and zookeeper via ambari. Now I am trying to install hive. I am able to install hive through the command line with "yum install hive*" Ambari is currently failing to install hcatalog. Looking at the ambari logs, I noticed this error: resource_management.core.exceptions.ExecutionFailed: Execution of '/usr/bin/yum -d 0 -e 0 -y install hcatalog' returned 1. Error: Nothing to do However, when installing via command line, I am able to install hcatalog with "yum install hive-hcatalog" Can someone please let me know how I can have ambari run the command /usr/bin/yum -d 0 -e 0 -y install hive-hcatalog instead of /usr/bin/yum -d 0 -e 0 -y install hcatalog Any help is much appreciated. Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
04-15-2021
10:23 AM
Hi experts, In one of our clusters, the datanode heap is currently at 70% and our warning thresholds are 80% and Error at 90%. I was wondering if its possible to manually initiate a garbage collection to see if the heap memory goes down. I checked the logs and it seems like the garbage collection got initiated right after our alert, so probably when the heap got up to about 80-90%. Any suggestions on how to properly monitor this alert or configuration recommendations? Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
04-13-2021
10:25 AM
Hi experts, Can someone please explain to me when running the exact same query in beeline and ambari hive view, that beeline query runs successfully but there is an error in ambari hive view. ambari hive view returned the error: "Result fetch timed out" Any help is much appreciated. Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
04-09-2021
05:45 AM
Hi experts, I just implemented hive LLAP in our hadoop dev cluster. When running "show databases", it takes hive LLAP about 0.5 seconds to give me an output, whereas, hiveserver2 without LLAP, it returns an output in 0.03 seconds. Can someone please let me know if there are any configurations or settings or something I may be missing? Thanks, Richmond
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
04-02-2021
10:27 AM
Hi experts, I have enabled ranger authorization on hiveserve2, however, I am having issues enabling ranger on hive LLAP. Can someone please let me know which property to add on to which file/config, or direct me to some documentation that shows how to enable ranger on hive LLAP? Thanks,
... View more
Labels:
03-29-2021
06:01 PM
ok sorry I just found the issue. Noticed the LLAP daemons were being run by the user hive whereas the AMs were being run by the user root. Now I have the AM and the daemons both being run by hive and now the Hive LLAP UI is being updated and working.
... View more
03-29-2021
05:51 PM
Hi experts, When I start hive LLAP, it seems to be working as I am able to access databases and tables via LLAP. However, the hive LLAP UI "state = completed". Also shows the wrong information such as the App id or does not even show any llap daemons running. I can clearly see that the AM and LLAP daemon is running. { "amInfo" : { "appName" : "llap_service", "appType" : "org-apache-slider", "appId" : "application_1616963398366_0079", "containerId" : "container_e59_1616963398366_0079_01_000001", "hostname" : "test04.domain.com", "amWebUrl" : "http://test04.domain.com:44972/" }, "state" : "RUNNING_ALL", "originalConfigurationPath" : "hdfs://test/user/hive/.slider/cluster/llap_service/snapshot", "generatedConfigurationPath" : "hdfs://test/user/hive/.slider/cluster/llap_service/generated", "desiredInstances" : 1, "liveInstances" : 1, "launchingInstances" : 0, "appStartTime" : 1617064445107, "runningThresholdAchieved" : true, "runningInstances" : [ { "hostname" : "test03.domain.com", "containerId" : "container_e59_1616963398366_0079_01_000002", "logUrl" : "http://test03.domain.com:8042/node/containerlogs/container_e59_1616963398366_0079_01_000002/hive", "statusUrl" : "http://test03.domain.com:15002/status", "webUrl" : "http://test03.domain.com:15002", "rpcPort" : 45767, "mgmtPort" : 15004, "shufflePort" : 15551, "yarnContainerExitStatus" : 0 } ] } Any help is much appreciated. Thanks,
... View more
Labels:
- Labels:
-
Apache Ambari
-
Apache Hadoop
-
Apache Hive
03-25-2021
02:25 PM
Hi experts, I was wondering if there is a place where it shows the enhancements between each hadoop component such as hadoop, yarn, hive, hbase, etc. So I am trying to find a reason to upgrade our hadoop clusters or wait for a newer version to come out. Any help is much appreciated. Thanks,
... View more
03-25-2021
09:05 AM
Thanks @Daming Xue for the response. So i tried installing Hive 2.2 and it worked. Do you know how I can test hive LLAP vs regular hiveserver2 to see the difference? Any good hiveserver2 queries or something so I can test the LLAP setup vs hiveserver2? Thanks,
... View more