https://community.cloudera.com/t5/Support-Questions/Spark-job-submit-log-messages-on-console/m-p/163047#M125421 <P><A rel="user" href="https://community.cloudera.com/users/10930/scarroll.html" nodeid="10930">@Sebastian Carroll</A> These options will work in both yarn-client and yarn-cluster mode. What you will need to do is ensure you have an appropriate file appender in the log4j configuration. </P><P>That said, if you have a job which is running for multiple days, you are far far better off using yarn-cluster mode to ensure the driver is safely located on the cluster, rather than relying on a single node with a yarn-client hooked to it.</P> Mon, 20 Feb 2017 18:49:10 GMT sball 2017-02-20T18:49:10Z