Getting Error as - Container marked as failed: container_e20_1513683381321_0015_01_000002 on host: FQDN-DN01. Exit status: 1. Diagnostics: Exception from container-launch.
Example I am running is -
spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 1 --driver-memory 512m --executor-memory 512m --conf spark.yarn.maxAppAttempts=1 --executor-cores 1 /usr/hdp/220.127.116.11-157/spark/lib/spark-examples-18.104.22.168.5.5.0-157-hadoop22.214.171.124.5.5.0-157.jar 10
HDP - 126.96.36.199-157
Hadoop - 2.7.3
Spark - 1.6.3
I am attaching detail error files as "Spark Query and Error.txt" and one of the container "stderr - Container.txt" file as attached.
Please let me know if you have any pointer to solve this spark issue.
@Amod Kulkarni , this issue should be related to mismatch in scala version.
Few relevant links: