question Re: [Ambari] Manage retention of hiveserver2.log file by using DailyRollingFileAppender in log4j through Ambari. in Support Questions

[Ambari] Manage retention of hiveserver2.log file by using DailyRollingFileAppender in log4j through Ambari.

mungeol_heo — Fri, 16 Sep 2022 12:03:38 GMT

Hello,

Does anyone know how to manage retention of hiveserver2.log file by using DailyRollingFileAppender in log4j through Ambari.

E.g. Keep last 30 days' log files which in hiveserver2.log.yyyy-MM-dd format.

BTW, it is DailyRollingFileAppender, not RollingFileAppender.

Thank you.

Re: [Ambari] Manage retention of hiveserver2.log file by using DailyRollingFileAppender in log4j through Ambari.

akhilsnaik — Tue, 08 Aug 2017 11:54:13 GMT

Go to etc/hive/conf

find a file called hive-log4j.prpoerties

# 30-day backup 

#log4j.appender.DRFA.MaxBackupIndex= 30

Find the abouve commented line inside the file.

Remove the # and modify value to 10.

I think this is one you are searching for .

Let me know if it works

Re: [Ambari] Manage retention of hiveserver2.log file by using DailyRollingFileAppender in log4j through Ambari.

mungeol_heo — Tue, 08 Aug 2017 12:18:56 GMT

Actually, I have done that through Ambari web UI.

However, it didn't work.

Here is what I have done.

Ambari web UI -> Hive -> Configs -> Advanced -> Advanced hive-log4j ->

Hive Log: # of backup files : 7

The "#" is removed from "#log4j.appender.DRFA.MaxBackupIndex={{hive_log_maxbackupindex}}"

After, restarting the hive server, the files placed below are changed.

/etc/hive/conf/hive-log4j.properties

/etc/hive/conf/conf.server/hive-log4j.properties

AFAIK, hiveserver2 uses the seconde file.

Thank you.

Re: [Ambari] Manage retention of hiveserver2.log file by using DailyRollingFileAppender in log4j through Ambari.

mungeol_heo — Thu, 10 Aug 2017 10:41:11 GMT

I don't think "log4j.appender.DRFA.MaxBackupIndex" is working, even though, it is listed in the log4j-hive.properties file by default and commented in Ambari.

I found out there are two options to achieve the similar goal.

Option 1: Customize DailyRollingFileAppender
- Reference: https://wiki.apache.org/logging-log4j/DailyRollingFileAppender
Option 2: Use the TimeBasedRollingPolicy of DailyRollingFileAppender
- Reference: https://stackoverflow.com/questions/5117758/configuring-rollingfileappender-in-log4j