Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

save ranger audit to HDFS Vs Ranger audit to DB?

avatar
Expert Contributor

whats the difference, prons and cons having ranger audit to DB vs ranger audit to HDFS?

1 ACCEPTED SOLUTION

avatar

Storing ranger audit logs on HDFS is beneficial for a couple of years:

A) It provides a more scalable distributed data store, so you can store logs for a lot longer

B) If you are currently leveraging Hadoop to store all security/audit logs. You can store your Ranger Audit logs along those in HDFS and be able to do better correlation between access request from different systems to help detect anomalies

Storing in the RBDMS was the original default. It provides better response times on smaller data sets but it's not as scalable and you will then need to maintain (e.g. purge/roll logs) on a set frequency.

Cheers,

Andrew

View solution in original post

3 REPLIES 3

avatar

Storing ranger audit logs on HDFS is beneficial for a couple of years:

A) It provides a more scalable distributed data store, so you can store logs for a lot longer

B) If you are currently leveraging Hadoop to store all security/audit logs. You can store your Ranger Audit logs along those in HDFS and be able to do better correlation between access request from different systems to help detect anomalies

Storing in the RBDMS was the original default. It provides better response times on smaller data sets but it's not as scalable and you will then need to maintain (e.g. purge/roll logs) on a set frequency.

Cheers,

Andrew

avatar
Expert Contributor

Thanks @Andrew Watson

@andrew watson

@Vperiasamy

Do we know which version of HDP saving ranger Audit to DB is going to be unsupported?

https://community.hortonworks.com/questions/2202/ranger-audit-options-is-db-audit-still-supported-i....

avatar
Rising Star

Ranger support for DB will most probably be phased out in the next release, it is being discussed in the community currently.