Created 06-07-2017 07:54 AM
Hi, I have been using oozie to schedule spark jobs. Trying to deploy a spark job in 2.x cluster using spark action available in Oozie.
In my job.properties, I have the following
<code> nameNode=hdfs://hostname:8020 jobTracker=hostname:8050 master=yarn-cluster queueName=default oozie.use.system.libpath=true
Whenever i submit the oozie job, i have been receiving this error
Error:
ErrorCode [JA009], Message [JA009: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses.] org.apache.oozie.action.ActionExecutorException: JA009: Cannot initialize Cluster. Please check your configuration for mapreduce.framework.name and the correspond server addresses. at org.apache.oozie.action.ActionExecutor.convertExceptionHelper(ActionExecutor.java:457)
Do i need to change anything in oozie configuration file regarding the mapreduce frame work? Currently it has been set to "yarn"
=> oozie/conf/hadoop-config.xml
<name>mapreduce.framework.name</name>
<value>yarn</value>
Thanks!
Created 06-07-2017 08:24 AM
Order of service restart: Yarn, Oozie.
Can check this: https://community.hortonworks.com/questions/52210/hdp-24-oozie-work-flow-ja009-cannot-initialize-clu...
Created 06-07-2017 04:02 PM
You should not need to change the value. "yarn" should be fine.
Created 06-07-2017 06:13 PM
Is it failing for this particular Spark job or all the Oozie jobs? As Mark pointed out, setting 'mapreduce.framework.name=yarn' should be fine. Also in case you have enabled Yarn RM HA, you should use jobTracker port 8032 instead of 8050.
Created 06-08-2017 05:49 AM
Yes..It is failing for all the oozie jobs. I have changed the job tracker port to 8032 and tried again. But still i have been facing the same issue !