Created 04-17-2019 03:22 PM
HDP 3.1
LLAP Daemon Container Max Headroom (MB) 12288M
LLAP Daemon Heap Size (MB) 8192M
Memory per Daemon 10000M
In-Memory Cache per Daemon 1024M
Start HiveServer2 Interactive service, after a while, service stop.
Connection failed on host edge3:10500 (Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/HIVE/package/alerts/alert_hive_interactive_thrift_port.py", line 210, in execute ldap_password=ldap_password) File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/hive_check.py", line 84, in check_thrift_port_sasl timeout_kill_strategy=TerminateStrategy.KILL_PROCESS_TREE, File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__ self.env.run() File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run self.run_action(resource, action) File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action provider_action() File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run returns=self.resource.returns) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner result = function(command, **kwargs) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper result = _call(command, **kwargs_copy) File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call raise ExecutionFailed(err_msg, code, out, err) ExecutionFailed: Execution of 'beeline -n hive -u 'jdbc:hive2://edge3:10500/;transportMode=binary' -e ';' 2>&1 | awk '{print}' | grep -i -e 'Connected to:' -e 'Transaction isolation:'' returned 1. )
In hive.log have some warning.
2019-04-17T09:50:54,680 INFO [main] LlapStatusServiceDriverConsole:
LLAPSTATUS WatchMode with timeout=400 s
2019-04-17T09:50:54,680 INFO [main] LlapStatusServiceDriverConsole:
--------------------------------------------------------------------------------
2019-04-17T09:50:54,680 INFO [main] LlapStatusServiceDriverConsole: LLAP status unknown
2019-04-17T09:50:54,680 INFO [main] LlapStatusServiceDriverConsole:
--------------------------------------------------------------------------------
2019-04-17T09:50:54,681 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:50:56,693 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:50:58,704 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:00,714 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:02,726 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:04,736 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:06,747 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:08,758 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:10,768 INFO [main] LlapStatusServiceDriverConsole: LLAP status unknown
2019-04-17T09:51:10,769 INFO [main] LlapStatusServiceDriverConsole:
--------------------------------------------------------------------------------
2019-04-17T09:51:10,769 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:12,778 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:14,789 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:16,799 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:18,809 WARN [main] status.LlapStatusServiceDriver: Watch mode enabled and got YARN error. Retrying..
2019-04-17T09:51:21,442 INFO [main] LlapStatusServiceDriverConsole: LLAP Application running with
ApplicationId=application_1555406776966_0288
2019-04-17T09:51:21,443 INFO [main] LlapStatusServiceDriverConsole:
--------------------------------------------------------------------------------
Created 04-17-2019 04:10 PM
Can you use Ambari install the YARN and HDFS and HS2 clients on host edge3 and retry !
Created 04-18-2019 02:40 AM
Thanks, I use Ambari install these clients on edge3
Created 04-18-2019 10:48 AM
Any updates?
Created 04-18-2019 11:04 AM
My cluster has installed these clients before and I haven't found a solution yet
Created 04-18-2019 11:43 AM
Can you have a look at this HCC LLAP reference
Created 04-19-2019 07:05 AM
Done.
HDFS > Configs > Custom core-site.xml:
hadoop.proxyuser.hive.hosts=*