question Re: Spark Streaming - out of memory when submit using Oozie in Archives of Support Questions (Read Only)

Spark Streaming - out of memory when submit using Oozie

butkiz — Fri, 16 Sep 2022 10:29:39 GMT

Dear Colleages,

I submitted a Spark Streaming job via Oozie and get the following error messages:

Warning: Skip remote jar hdfs://quickstart.cloudera:8020/user/oozie/share/lib/lib_20160405235854/oozie/oozie-sharelib-oozie.jar.
Halting due to Out Of Memory Error...
Halting due to Out Of Memory Error...

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "LeaseRenewer:hdfs@quickstart.cloudera:8020"

Exception: java.lang.OutOfMemoryError thrown from the UncaughtExceptionHandler in thread "Executor task launch worker-2"

Do you have an idea or a solution to prevent these error messages?

Thanks in advance and best regards,

butkiz

Re: Spark Streaming - out of memory when submit using Oozie

kchaitanya — Mon, 19 Sep 2016 12:09:30 GMT

Hi,

Have you fixed the issue..?

Re: Spark Streaming - out of memory when submit using Oozie

roczei — Tue, 20 Sep 2016 09:54:37 GMT

Dear butkiz,

Please add the following property to the configuration block of the oozie spark action to give this more memory.

<property>
<name>oozie.launcher.mapreduce.map.memory.mb</name>
<value>4096</value>
</property>
<property>
<name>mapreduce.map.memory.mb</name>
<value>4096</value>
</property>
<property>
<name>oozie.launcher.mapred.child.java.opts</name>
<value>-Xmx4096m</value>
</property>

Re: Spark Streaming - out of memory when submit using Oozie

butkiz — Thu, 29 Sep 2016 13:07:28 GMT

Hi,

it works applying above configuration.

But now i have a NullPointerException in my spark code (rdd.foreach):
...

kafkaStream.foreachRDD(new VoidFunction<JavaPairRDD<String, byte[]>>() {
			
			public void call(JavaPairRDD<String, byte[]> rdd) throws Exception {
			    rdd.foreach(new VoidFunction<Tuple2<String, byte[]>>() {
					
			    	public void call(Tuple2<String, byte[]> avroRecord) throws Exception {

In local mode it works but not in yarn-cluster.

Do you have any ideas in order to get it running?

Best Regards,

Butkiz