Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

spark history

spark history

New Contributor

Hi, As part of HDP 3.1 stack when we try to start Spark-history-server, it fails looking for hive metastore db details. We do not have hive in our install pack for this cluster. ( We do not want to install hive in this). How do we proceed with spark-history-server start, without hive?

cc : @Dharmesh Jain
The error log :

Traceback (most recent call last):  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SPARK2/package/scripts/job_history_server.py", line 102, in <module>    JobHistoryServer().execute()  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/script.py", line 352, in execute    method(env)  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SPARK2/package/scripts/job_history_server.py", line 55, in start    spark_service('jobhistoryserver', upgrade_type=upgrade_type, action='start')  File "/var/lib/ambari-agent/cache/stacks/HDP/3.0/services/SPARK2/package/scripts/spark_service.py", line 105, in spark_service    create_catalog_cmd = format("{hive_schematool_bin}/schematool -dbType {hive_metastore_db_type} "  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/format.py", line 95, in format    return ConfigurationFormatter().format(format_string, args, **result)  File "/usr/lib/ambari-agent/lib/resource_management/libraries/functions/format.py", line 59, in format    result_protected = self.vformat(format_string, args, all_params)  File "/usr/lib64/python2.7/string.py", line 549, in vformat    result = self._vformat(format_string, args, kwargs, used_args, 2)  File "/usr/lib64/python2.7/string.py", line 582, in _vformat    result.append(self.format_field(obj, format_spec))  File "/usr/lib64/python2.7/string.py", line 599, in format_field    return format(value, format_spec)  File "/usr/lib/ambari-agent/lib/resource_management/libraries/script/config_dictionary.py", line 73, in __getattr__    raise Fail("Configuration parameter '" + self.name + "' was not found in configurations dictionary!") resource_management.core.exceptions.Fail: Configuration parameter 'hive-env' was not found in configurations dictionary!
Don't have an account?
Coming from Hortonworks? Activate your account here