Support Questions
Find answers, ask questions, and share your expertise

Kafka spool log files

Contributor

Hi,

I found following log files in /var/log/log_hadoop/log/kafka/audit/hdfs/spool/archive path and these are taking lot of space. What are these files? Can I delete these files? How to control it?

11G spool_kafka_20171022-0406.23.log

11G spool_kafka_20171023-0406.30.log

11G spool_kafka_20171024-0406.30.log

11G spool_kafka_20171025-0406.31.log

11G spool_kafka_20171026-0406.32.log

3 REPLIES 3

Super Collaborator

That's the Ranger Kafka Plugin logging HDFS auditing. https://github.com/apache/ranger/blob/master/plugin-kafka/scripts/install.properties#L65

Log into Ranger Admin UI if you want to disable it.

Contributor

Can we delete these files?

Super Collaborator

Do you need auditing in your system, then no.

If not, then yes, and why did you have it enabled?

Take a Tour of the Community
Don't have an account?
Your experience may be limited. Sign in to explore more.