Created on 12-04-2018 02:49 PM - edited 09-16-2022 06:57 AM
I have a Oozie job which starts a Oozie shell action,the shell action starts a spark application (spark2-submit). I am mostly doing spark sql. The jobs runs for a while and suddenly hangs. It starts the spark application all over again.
I ran the same spark application in CDSW and it ran fine without issues.
The same is happening with other Oozie job . The only common thing between these two jobs is that they run longer, around 2hrs.
Any help will be helpful.
Created 12-07-2018 02:38 PM
The oozie mapper was running out of 4GB memory. I changed that to 8GB. Now the job ran fine without restarts.
<configuration>
<property>
<name>oozie.launcher.mapreduce.map.memory.mb</name>
<value>8000</value>
</property>
<property>
<name>oozie.launcher.mapreduce.map.java.opts</name>
<value>-Xmx1500m</value>
</property>
<property>
<name>oozie.launcher.yarn.app.mapreduce.am.resource.mb</name>
<value>1024</value>
</property>
<property>
<name>oozie.launcher.mapreduce.map.java.opts</name>
<value>-Xmx870m</value>
</property>
</configuration>
Created 12-07-2018 02:38 PM
Thanks for help
Created 12-08-2018 06:08 AM
Congratulations on resolving your issue @Sunil. Please don't forget to mark the reply that helped resolve the issue as the answer. That way when others have a similar issue they will be more likely to find it.
Created 12-08-2018 07:45 AM
Great Sunil
Regards
Bimal
Created 01-02-2019 10:34 AM
I get the following error
line 2: spark-submit: command not found Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], exit code [1]
Created 01-02-2019 10:50 AM
We submit the jobs someothing like this.