Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Spark Example Test shows error “Launch container failed”

Spark Example Test shows error “Launch container failed”

New Contributor

Getting Error as - Container marked as failed: container_e20_1513683381321_0015_01_000002 on host: FQDN-DN01. Exit status: 1. Diagnostics: Exception from container-launch.

Example I am running is -

spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 1 --driver-memory 512m --executor-memory 512m --conf spark.yarn.maxAppAttempts=1 --executor-cores 1 /usr/hdp/2.5.5.0-157/spark/lib/spark-examples-1.6.3.2.5.5.0-157-hadoop2.7.3.2.5.5.0-157.jar 10

Versions -

HDP - 2.5.5.0-157

Hadoop - 2.7.3

Spark - 1.6.3

I am attaching detail error files as "Spark Query and Error.txt" and one of the container "stderr - Container.txt" file as attached.

Please let me know if you have any pointer to solve this spark issue.

spark-query-and-error.txtstderr-container.txt

1 REPLY 1
Highlighted

Re: Spark Example Test shows error “Launch container failed”

Guru