Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Hive on Tez : yarn logs missing timestamp for TezChild

Hive on Tez : yarn logs missing timestamp for TezChild

New Contributor

Hi,

 
We are using Hive on Tez (see versions below) and aren't able to get TezChild class to log the timestamp even though tez-container-log4j.properties has the ISO time in the logger pattern (see log4j contents below).
 
Sample Logs:
[TezChild] INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator - FS[3]: records written - 100
[TezChild] INFO org.apache.hadoop.hive.ql.exec.MapOperator - MAP[0]: records read - 100
[TezChild] INFO org.apache.hadoop.hive.ql.exec.FileSinkOperator - FS[3]: records written - 1000
[TezChild] INFO org.apache.hadoop.hive.ql.exec.MapOperator - MAP[0]: records read - 1000
 
Anyone faced this same issue and resolve it ?
 
Hive Version: 2.0.1
Hadoop Version: 2.9.2
Tez: 0.9.1
 
The file tez-container-log4j.properties is passed via -Dlog4j.configuration to the container and -Dlog4j.configuratorClass is set to org.apache.tez.common.TezLog4jConfigurator, below are the content for the log4j.properties

 

#
# ContainerLog Appender
#

log4j.appender.CLA=org.apache.tez.common.TezContainerLogAppender
log4j.appender.CLA.containerLogDir=${yarn.app.container.log.dir}

log4j.appender.CLA.layout=org.apache.log4j.PatternLayout
log4j.appender.CLA.layout.ConversionPattern=%d{ISO8601} [%p] [%t] |%c{2}|: %m%n

 
Thanks,
Viral
 
Don't have an account?
Coming from Hortonworks? Activate your account here