The location of Spark application history logs in HDFS is configured under spark.eventLog.dir which is set as /user/spark/applicationHistory. So your required logs can be found under this path.   The /user/spark/driverLogs path contains only the spark driver logs in HDFS when Spark application runs in client mode.   Please refer the below link for more details : https://docs.cloudera.com/documentation/enterprise/6/properties/6.3/topics/cm_props_cdh630_spark.html#concept_6.3.x_service_wide_props__section_other_props ... View more