I have a requirement where I need to move the Ranger logs accumulated in HDFS to Amazon S3. How can I make this work. Alternately can I accumulate the logs in S3 itself going forward. Is that an option?
Currently there is no such option to store Ranger audit log directly in S3 instead of HDFS. As of now, you'll need to do in two steps i.e. first let the audit get collected in HDFS, then move them to S3 via a periodic job or some S3 connector of your choice.