[Ambari] Manage retention of hiveserver2.log file by using DailyRollingFileAppender in log4j through Ambari.

[#1]

Hello,

Does anyone know how to manage retention of hiveserver2.log file by using DailyRollingFileAppender in log4j through Ambari.

E.g. Keep last 30 days' log files which in hiveserver2.log.yyyy-MM-dd format.

BTW, it is DailyRollingFileAppender, not RollingFileAppender.

Thank you.

[#2]

Go to etc/hive/conf

find a file called hive-log4j.prpoerties

# 30-day backup 

#log4j.appender.DRFA.MaxBackupIndex= 30

Find the abouve commented line inside the file.

Remove the # and modify value to 10.

I think this is one you are searching for .

Let me know if it works

[#3]

Actually, I have done that through Ambari web UI.

However, it didn't work.

Here is what I have done.

Ambari web UI -> Hive -> Configs -> Advanced -> Advanced hive-log4j ->

Hive Log: # of backup files : 7

The "#" is removed from "#log4j.appender.DRFA.MaxBackupIndex={{hive_log_maxbackupindex}}"

After, restarting the hive server, the files placed below are changed.

/etc/hive/conf/hive-log4j.properties

/etc/hive/conf/conf.server/hive-log4j.properties

AFAIK, hiveserver2 uses the seconde file.

Thank you.

[#4 · Accepted solution]

I don't think "log4j.appender.DRFA.MaxBackupIndex" is working, even though, it is listed in the log4j-hive.properties file by default and commented in Ambari.

I found out there are two options to achieve the similar goal.

• Option 1: Customize DailyRollingFileAppender
  • Reference: https://wiki.apache.org/logging-log4j/DailyRollingFileAppender
    
• Option 2: Use the TimeBasedRollingPolicy of DailyRollingFileAppender
  • Reference: https://stackoverflow.com/questions/5117758/configuring-rollingfileappender-in-log4j