Reply
New Contributor
Posts: 1
Registered: ‎08-02-2016

How to configre HiveContext to work in spark on VM 5.4

Hi ,

  I want to run hive queries in spark using HiveContext, I read that a pre-requisite for this is to copy hive-site.xml from hive conf directory to $SPARK_HOME/conf/hive-site.xml , but on the VM I found multiple instances of hive-site.xml so how to identify which one is actually used, please mention how to find out not just the path.

 

Also $SPARK_HOME is not defined, so how to find it out?

 

Note: I'm not using cloudera manager becuase of memory limitation.

 

Best Regards,

Mahmoud