Welcome to the Cloudera Community

Announcements
Celebrating as our community reaches 100,000 members! Thank you!

Who agreed with this topic

TimeoutException: during spark submit

avatar
New Contributor

I am getting following error at the yarn application level 

 

 

Stack trace: ExitCodeException exitCode=1:

        at org.apache.hadoop.util.Shell.runCommand(Shell.java:601)

        at org.apache.hadoop.util.Shell.run(Shell.java:504)

        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:786)

        at org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.launchContainer(LinuxContainerExecutor.java:373)

        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)

        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

        at java.lang.Thread.run(Thread.java:745)

 

 

 

and i am getting following error at yarn container level

 

java.lang.RuntimeException: java.util.concurrent.TimeoutException: Timeout waiting for task.

        at org.spark-project.guava.base.Throwables.propagate(Throwables.java:160)

        at org.apache.spark.network.client.TransportClient.sendRpcSync(TransportClient.java:278)

        at org.apache.spark.network.sasl.SaslClientBootstrap.doBootstrap(SaslClientBootstrap.java:80)

        at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:228)

        at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:167)

        at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:199)

        at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:190)

        at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:186)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

        at java.lang.Thread.run(Thread.java:745)

Caused by: java.util.concurrent.TimeoutException: Timeout waiting for task.

        at org.spark-project.guava.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:276)

        at org.spark-project.guava.util.concurrent.AbstractFuture.get(AbstractFuture.java:96)

        at org.apache.spark.network.client.TransportClient.sendRpcSync(TransportClient.java:274)

        ... 10 more

Exception in thread "main" java.lang.RuntimeException: java.util.concurrent.TimeoutException: Timeout waiting for task.

        at org.spark-project.guava.base.Throwables.propagate(Throwables.java:160)

        at org.apache.spark.network.client.TransportClient.sendRpcSync(TransportClient.java:278)

        at org.apache.spark.network.sasl.SaslClientBootstrap.doBootstrap(SaslClientBootstrap.java:80)

        at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:228)

        at org.apache.spark.network.client.TransportClientFactory.createClient(TransportClientFactory.java:167)

        at org.apache.spark.rpc.netty.NettyRpcEnv.createClient(NettyRpcEnv.scala:199)

        at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:190)

        at org.apache.spark.rpc.netty.Outbox$$anon$1.call(Outbox.scala:186)

        at java.util.concurrent.FutureTask.run(FutureTask.java:266)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

        at java.lang.Thread.run(Thread.java:745)

Caused by: java.util.concurrent.TimeoutException: Timeout waiting for task.

        at org.spark-project.guava.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:276)

        at org.spark-project.guava.util.concurrent.AbstractFuture.get(AbstractFuture.java:96)

        at org.apache.spark.network.client.TransportClient.sendRpcSync(TransportClient.java:274)

        ... 10 more

 

 

I am using following spark submit command 

 

spark-submit  --class com.data.stream.loadusertable --driver-memory 5g --executor-memory 5g --executor-cores 4  --conf spark.yarn.executor.memoryOverhead=4044

Who agreed with this topic