Support Questions

Find answers, ask questions, and share your expertise

Failing Oozie-Spark with core-site.xml (Permission denied)

Hello all,

I am getting Permission denied error below when launching Oozie-Spark workflow. Also the directory with read, write access


drwxrwxrwx 2 yarn hadoop 10 Jul 20 11:30 appcache

Could anyone please help me with below error? I really appreciated. Thanks

Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], main() threw exception, /opt/data/yarn/local/usercache/oozie/appcache/application_1500495991334_1431/container_e04_1500495991334_1431_01_000002/core-site.xml (Permission denied) /opt/data/yarn/local/usercache/oozie/appcache/application_1500495991334_1431/container_e04_1500495991334_1431_01_000002/core-site.xml (Permission denied)

Cloudera Employee

@JT Ng

As the error itself says, the oozie user is not able to access the file most probably.

So, check the permission on the entire path to the file, not just the very last folder in the file path.


Hi @nkumar

I copied core-site.xml file into app path. and give permission as group hdfs and user hdfs as I am running SparkAction as hdfs user.

-rw-r--r--   3 hdfs hdfs       3371 2018-06-07 07:27 /user/hdfs/sparkoozie/TransformationOper.jar
-rw-r--r--   3 hdfs hdfs        774 2018-06-07 07:27 /user/hdfs/sparkoozie/core-site.xml
-rw-r--r--   3 hdfs hdfs        390 2018-06-07 07:27 /user/hdfs/sparkoozie/
-rw-r--r--   3 hdfs hdfs        923 2018-06-07 07:27 /user/hdfs/sparkoozie/workflow.xml

But still I am getting above error.




@JT Ng Oozie spark action is not supported instead use spark oozie shell action.

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.