I'm upgrading from HDP 2.4.2.0 to 2.6.2.0. All tasks from Ambari wizard were performed OK but Spark fails.
I got this error message while restarting Spark Thrift Server
Traceback (most recent call last):
File "/var/lib/ambari-agent/cache/common-services/SPARK/1.2.1/package/scripts/spark_thrift_server.py", line 87, in <module>
SparkThriftServer().execute()
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 329, in execute
method(env)
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/script.py", line 830, in restart
self.stop(env, upgrade_type=upgrade_type)
File "/var/lib/ambari-agent/cache/common-services/SPARK/1.2.1/package/scripts/spark_thrift_server.py", line 57, in stop
import params
File "/var/lib/ambari-agent/cache/common-services/SPARK/1.2.1/package/scripts/params.py", line 262, in <module>
livy_principal = livy_kerberos_principal.replace('_HOST', config['hostname'].lower())
File "/usr/lib/python2.6/site-packages/resource_management/libraries/script/config_dictionary.py", line 73, in __getattr__
raise Fail("Configuration parameter '" + self.name + "' was not found in configurations dictionary!")
resource_management.core.exceptions.Fail: Configuration parameter 'livy.server.launch.kerberos.principal' was not found in configurations dictionary!
I just added livy.server.launch.kerberos.principal in /etc/livy/conf/livy-defaults.conf but doesn't work.
What should I do? Thanks in advance!