When we are trying to install Spark Controller via Ambari, it is giving error. All pre-installation activities are cool. below is the error we are getting: stderr: /var/lib/ambari-agent/data/errors-403.txt File "/var/lib/ambari-agent/cache/stacks/HDP/2.3/services/SparkController/package/scripts/controller_conf.py", line 10, in controller_conf recursive = True File "/usr/lib/python2.6/site-packages/resource_management/core/base.py", line 147, in __init__ raise Fail("%s received unsupported argument %s" % (self, key)) resource_management.core.exceptions.Fail: Directory['/usr/sap/spark/controller/conf'] received unsupported argument recursive stdout: /var/lib/ambari-agent/data/output-403.txt 2016-12-15 08:44:36,441 - Skipping installation of existing package curl 2016-12-15 08:44:36,441 - Package['hdp-select'] {'retry_on_repo_unavailability': False, 'retry_count': 5} 2016-12-15 08:44:36,496 - Skipping installation of existing package hdp-select Start installing 2016-12-15 08:44:36,668 - Execute['cp -r /var/lib/ambari-agent/cache/stacks/HDP/2.3/services/SparkController/package/files/sap/spark /usr/sap'] {} 2016-12-15 08:44:36,685 - Execute['chown hanaes:sapsys /var/log/hanaes'] {} Configuring... Command failed after 1 tries ... View more

We have installed HDP 2.3.0.0(2.3.0.0-2557) on our cluster managed by Ambari 2.4.2.0. When we are starting the spark thrift server, it errors out. Upon checking we found that the package directory "/usr/hdp/current/spark-thriftserver/" doesn't exist. this directory should had been created while installation but it is not. Any solutions how to deal with this. ... View more

Hi Guyzz, I have a business requirement to install Spark1.5.2 in our cluster as this version is compatible with Hana Spark Controller 1.6.1. So I want to know exact Ambari repository and HDP version which I should be using during the installation. ... View more