Support Questions
Find answers, ask questions, and share your expertise

Moving Ranger HDFS Logs to S3

Explorer

I have a requirement where I need to move the Ranger logs accumulated in HDFS to Amazon S3. How can I make this work. Alternately can I accumulate the logs in S3 itself going forward. Is that an option?

1 REPLY 1

Guru

Hello @Abhilash Chandra,

Currently there is no such option to store Ranger audit log directly in S3 instead of HDFS. As of now, you'll need to do in two steps i.e. first let the audit get collected in HDFS, then move them to S3 via a periodic job or some S3 connector of your choice.

Hope this helps.