Support Questions
Find answers, ask questions, and share your expertise

Can ranger logs be written to Kafka topic?

Can ranger logs be written to Kafka topic?

New Contributor
 
3 REPLIES 3
Highlighted

Re: Can ranger logs be written to Kafka topic?

@gm Sure they can.  For example: this is a simple use case for nifi to tail a log file and send the results to a Kafka topic.

 

There are many other ways to do this without nifi too.

 

 

Highlighted

Re: Can ranger logs be written to Kafka topic?

New Contributor

How to set up Ranger logs to branch off to Kafka topic(s)?

Highlighted

Re: Can ranger logs be written to Kafka topic?

Expert Contributor

You'll need to create a Kafka producer that reads the tail of the Ranger log files and pushes that to a Kafka topic. Here is an example of an implementation in Python.

Don't have an account?