Skip to main content
rrrajesh
Gold ⭐️⭐️
Gold ⭐️⭐️
February 3, 2018

GC logging for Spark History Server

  • October 5, 2026 at 9:13 AM
  • 0 replies
  • 2260 views
  • Translate All

To print GC details, please add the following line in Spark--> config--> Advanced spark-env --> spark-env template and restart spark history server.


export SPARK_DAEMON_JAVA_OPTS=" -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:{{spark_log_dir}}/spark_history_server.gc.`date +'%Y%m%d%H%M'`"