Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can ranger logs be written to Kafka topic?

Can ranger logs be written to Kafka topic?

New Contributor
 
3 REPLIES 3
Highlighted

Re: Can ranger logs be written to Kafka topic?

Master Collaborator

@gm Sure they can.  For example: this is a simple use case for nifi to tail a log file and send the results to a Kafka topic.

 

There are many other ways to do this without nifi too.

 

 

 


 


If this answer resolves your issue or allows you to move forward, please choose to ACCEPT this solution and close this topic. If you have further dialogue on this topic please comment here or feel free to private message me. If you have new questions related to your Use Case please create separate topic and feel free to tag me in your post.  


 


Thanks,



Steven

Highlighted

Re: Can ranger logs be written to Kafka topic?

New Contributor

How to set up Ranger logs to branch off to Kafka topic(s)?

Highlighted

Re: Can ranger logs be written to Kafka topic?

Rising Star

You'll need to create a Kafka producer that reads the tail of the Ranger log files and pushes that to a Kafka topic. Here is an example of an implementation in Python.

Don't have an account?
Coming from Hortonworks? Activate your account here