Support Questions
Find answers, ask questions, and share your expertise

Spark thrift server does not start in HDP 3.1 cluster.

Spark thrift server does not start in HDP 3.1 cluster.

New Contributor

Once the thrift process starts, it tries to check the connection of STS and fails there. Error log :
cc: @Dharmesh Jain

Traceback (most recent call last):  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SPARK2/package/scripts/spark_service.py", line 156, in spark_service    Execute(cmd, user=params.spark_user, path=[beeline_cmd], timeout=CHECK_COMMAND_TIMEOUT_DEFAULT)  File "/usr/lib/ambari-agent/lib/resource_management/core/base.py", line 166, in __init__    self.env.run()  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 160, in run    self.run_action(resource, action)  File "/usr/lib/ambari-agent/lib/resource_management/core/environment.py", line 124, in run_action    provider_action()  File "/usr/lib/ambari-agent/lib/resource_management/core/providers/system.py", line 263, in action_run    returns=self.resource.returns)  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 72, in inner    result = function(command, **kwargs)  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 102, in checked_call    tries=tries, try_sleep=try_sleep, timeout_kill_strategy=timeout_kill_strategy, returns=returns)  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 150, in _call_wrapper    result = _call(command, **kwargs_copy)  File "/usr/lib/ambari-agent/lib/resource_management/core/shell.py", line 314, in _call    raise ExecutionFailed(err_msg, code, out, err) ExecutionFailed: Execution of '! /usr/hdp/current/spark2-thriftserver/bin/beeline -u 'jdbc:hive2://chs-otf-615-mn003.us-south.ae.test.appdomain.cloud:10002/default;transportMode=http'  -e '' 2>&1| awk '{print}'|grep -i -e 'Connection refused' -e 'Invalid URL' -e 'Error: Could not open'' returned 1. Error: Could not open client transport with JDBC Uri: jdbc:hive2://chs-otf-615-mn003.us-south.ae.test.appdomain.cloud:10002/default;transportMode=http: Could not create http connection to jdbc:hive2://chs-otf-615-mn003.us-south.ae.test.appdomain.cloud:10002/default;transportMode=http. HTTP Response code: 405 (state=08S01,code=0) Error: Could not open client transport with JDBC Uri: jdbc:hive2://chs-otf-615-mn003.us-south.ae.test.appdomain.cloud:10002/default;transportMode=http: Could not create http connection to jdbc:hive2://chs-otf-615-mn003.us-south.ae.test.appdomain.cloud:10002/default;transportMode=http. HTTP Response code: 405 (state=08S01,code=0)