Found another way of achieving this which also works for PySpark in an Oozie Spark action. Add this to the <spark-opts> tag in the action definition: --conf spark.yarn.appMasterEnv.hive.metastore.uris=thrift://<your-hive-metastore>:9083 This will add the metastore URI to the application master environment and should allow successful connection to Hive for using tables inside a PySpark script.
... View more
