https://community.cloudera.com/t5/Support-Questions/Spark-job-submit-log-messages-on-console/m-p/163046#M125420 <P>Hi Simmon, </P><P>Thanks for the tip. Anyway, I have an additional question : I guess this configuration works in "yarn-cluster" mode (when driver and executors run under yarn responsibility on the cluster nodes) ?</P><P>My problem comes from the fact that I perform my spark-submit in "yarn-client" mode, which means that my driver is not managed by yarn, and the consequence is that the logs from the driver application go to the console from the server where I performed my "spark-submit" command. As this is a long-run job (several days), I would like to redirect the driver's logs to dedicated file thanks to log4j configuration, but couldn't succeed with this configuration...? Any idea how to achieve this ?</P><P>Thanks again</P> Mon, 20 Feb 2017 18:41:42 GMT schausson 2017-02-20T18:41:42Z