Support Questions
Find answers, ask questions, and share your expertise

Hive on Tez : yarn logs missing timestamp for TezChild

New Contributor

Hi,

 
We are using Hive on Tez (see versions below) and aren't able to get TezChild class to log the timestamp even though tez-container-log4j.properties has the ISO time in the logger pattern (see log4j contents below).
 
Sample Logs:
[TezChild] INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator - FS[3]: records written - 100
[TezChild] INFO org.apache.hadoop.hive.ql.exec.MapOperator - MAP[0]: records read - 100
[TezChild] INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator - FS[3]: records written - 1000
[TezChild] INFO org.apache.hadoop.hive.ql.exec.MapOperator - MAP[0]: records read - 1000
 
Anyone faced this same issue and resolve it ?
 
Hive Version: 2.0.1
Hadoop Version: 2.9.2
Tez: 0.9.1
 
The file tez-container-log4j.properties is passed via -Dlog4j.configuration to the container and -Dlog4j.configuratorClass is set to org.apache.tez.common.TezLog4jConfigurator, below are the content for the log4j.properties

 

#
# ContainerLog Appender
#

log4j.appender.CLA=org.apache.tez.common.TezContainerLogAppender
log4j.appender.CLA.containerLogDir=${yarn.app.container.log.dir}

log4j.appender.CLA.layout=org.apache.log4j.PatternLayout
log4j.appender.CLA.layout.ConversionPattern=%d{ISO8601} [%p] [%t] |%c{2}|: %m%n

 
Thanks,
Viral
 
0 REPLIES 0