Spark Example Test shows error “Launch container failed”

[#1]

Getting Error as - Container marked as failed: container_e20_1513683381321_0015_01_000002 on host: FQDN-DN01. Exit status: 1. Diagnostics: Exception from container-launch.

Example I am running is -

spark-submit --class org.apache.spark.examples.SparkPi --master yarn-client --num-executors 1 --driver-memory 512m --executor-memory 512m --conf spark.yarn.maxAppAttempts=1 --executor-cores 1 /usr/hdp/2.5.5.0-157/spark/lib/spark-examples-1.6.3.2.5.5.0-157-hadoop2.7.3.2.5.5.0-157.jar 10

Versions -

HDP - 2.5.5.0-157

Hadoop - 2.7.3

Spark - 1.6.3

I am attaching detail error files as "Spark Query and Error.txt" and one of the container "stderr - Container.txt" file as attached.

Please let me know if you have any pointer to solve this spark issue.

spark-query-and-error.txtstderr-container.txt

[#2]

@Amod Kulkarni , this issue should be related to mismatch in scala version.

Few relevant links:

https://stackoverflow.com/questions/25089852/what-is-the-reason-for-java-lang-nosuchmethoderror-scal...

https://issues.apache.org/jira/browse/SPARK-5483