question Re: hdfs-audit.log disk space consumption in Archives of Support Questions (Read Only)

hdfs-audit.log disk space consumption

timothy.pool — Fri, 16 Sep 2022 10:37:13 GMT

Been using CDH 5.3.1 and have been running into an issue where HDFS audit logging is consuming over 5GB an hour. This level of logging is unsustainable. How do I go about either turning off audit logging OR update the system so that it only retains say 3 or so audit logs?

Re: hdfs-audit.log disk space consumption

Khirod — Wed, 31 Aug 2016 07:20:36 GMT

Here are the properties you may need to update :

1) Maximum Audit Log File Size => check the size you want to set

2) Number of Audit Logs to Retain => Number of backup file you want to retain.

Thanks,

Khirod

Re: hdfs-audit.log disk space consumption

timothy.pool — Thu, 01 Sep 2016 16:12:40 GMT

Requires Cloudera Enterprise Licenses - kind of silly to require a paid subscription to be able to better manage the audit logs. Sounds like I'll just have to set up a cron job that prunes these logs every 15 minutes.