Member since
05-13-2016
3
Posts
5
Kudos Received
1
Solution
My Accepted Solutions
Title | Views | Posted |
---|---|---|
10028 | 05-17-2016 12:58 AM |
12-20-2016
06:02 AM
1 Kudo
Found another way of achieving this which also works for PySpark in an Oozie Spark action. Add this to the <spark-opts> tag in the action definition: --conf spark.yarn.appMasterEnv.hive.metastore.uris=thrift://<your-hive-metastore>:9083 This will add the metastore URI to the application master environment and should allow successful connection to Hive for using tables inside a PySpark script.
... View more