Created 10-27-2017 01:58 PM
Hi,
I found following log files in /var/log/log_hadoop/log/kafka/audit/hdfs/spool/archive path and these are taking lot of space. What are these files? Can I delete these files? How to control it?
11G spool_kafka_20171022-0406.23.log
11G spool_kafka_20171023-0406.30.log
11G spool_kafka_20171024-0406.30.log
11G spool_kafka_20171025-0406.31.log
11G spool_kafka_20171026-0406.32.log
Created 10-27-2017 09:06 PM
That's the Ranger Kafka Plugin logging HDFS auditing. https://github.com/apache/ranger/blob/master/plugin-kafka/scripts/install.properties#L65
Log into Ranger Admin UI if you want to disable it.
Created 10-28-2017 05:10 AM
Can we delete these files?
Created 10-30-2017 04:15 AM
Do you need auditing in your system, then no.
If not, then yes, and why did you have it enabled?