https://community.cloudera.com/t5/Support-Questions/Spark-job-submit-log-messages-on-console/m-p/163049#M125423 <P>Well,couldn't make it work...</P><P>I tried out several options : </P><P>I successfully got drivers logs in dedicated log file when using following option with my "spark-submit" command line : --driver-java-options "-Dlog4j.configuration=file:///local/home/.../log4j.properties" </P><P>Couldn't obtain the same with your suggestion : --conf "spark.driver.extraJavaOptions=...</P><P>For executors' logs, I gave a try with your suggestion as well : --conf "spark.executor.extraJavaOptions=... but failed to notice any change to logging mechanism. I guess this is a classpath issue, but couldn't find any relevant example in the documentation <span class="lia-unicode-emoji" title=":disappointed_face:">😞</span> </P><P>If I use --conf "spark.executor.extraJavaOptions=-Dlog4j.configuration=log4j.properties", where should I put this log4j.properties file ? in the "root" folder of the fat jar that I pass to spark-submit command ? somewhere else ?</P><P>Note that I also tried with :</P><P>--conf "spark.executor.extraJavaOptions=-Dlog4j.configuration=file:///local/home/.../log4j.properties" to point to an external file (not in the jar file) but it failed too...</P><P>Any idea about something wrong in my configuration ?</P><P>Thanks for your help</P> Mon, 20 Feb 2017 21:26:02 GMT schausson 2017-02-20T21:26:02Z