Support Questions
Find answers, ask questions, and share your expertise

Spark Example Test shows error “Launch container failed”

New Contributor

Getting Error as - Container marked as failed: container_e20_1513683381321_0015_01_000002 on host: FQDN-DN01. Exit status: 1. Diagnostics: Exception from container-launch.

Example I am running is -

spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 1 --driver-memory 512m --executor-memory 512m --conf spark.yarn.maxAppAttempts=1 --executor-cores 1 /usr/hdp/2.5.5.0-157/spark/lib/spark-examples-1.6.3.2.5.5.0-157-hadoop2.7.3.2.5.5.0-157.jar 10

Versions -

HDP - 2.5.5.0-157

Hadoop - 2.7.3

Spark - 1.6.3

I am attaching detail error files as "Spark Query and Error.txt" and one of the container "stderr - Container.txt" file as attached.

Please let me know if you have any pointer to solve this spark issue.

spark-query-and-error.txtstderr-container.txt

1 REPLY 1

Re: Spark Example Test shows error “Launch container failed”

Guru