You can include the below in spark-defaults.conf   spark.driver.extraLibraryPath   native path($HADOOP_HOME/lib/native/) ... View more

try the below command to get the detailed log.   $HADOOP_HOME/bin/yarn logs -applicationId application_1419229907721_0010     ... View more