01-31-2019 08:10 AM - last edited on 02-01-2019 06:33 AM by cjervis
I just installed Spark 2 on my cluster that is managed by Cloudera Manager. I can run the canary test and the SparkPi job using YARN as the application master. However, when try and access the Hive metastore I get a "connection refused" error. I suspect that I need to configure Spark 2 with the location of the metastore, but I'm not sure how to do that: there doesn't seem to be a setting in Cloudera Manager, and I'm reluctant to modify any of the configuration files without further guidance. Can anyone help?
02-05-2019 01:11 AM
Did you check 'Hive' for 'Hive Service' parameter in Spark configuration? You can do that in Cloudera Manager UI. By default it is marked as 'none'.