- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
save ranger audit to HDFS Vs Ranger audit to DB?
- Labels:
-
Apache Ranger
Created ‎03-11-2016 03:25 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
whats the difference, prons and cons having ranger audit to DB vs ranger audit to HDFS?
Created ‎03-11-2016 04:08 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Storing ranger audit logs on HDFS is beneficial for a couple of years:
A) It provides a more scalable distributed data store, so you can store logs for a lot longer
B) If you are currently leveraging Hadoop to store all security/audit logs. You can store your Ranger Audit logs along those in HDFS and be able to do better correlation between access request from different systems to help detect anomalies
Storing in the RBDMS was the original default. It provides better response times on smaller data sets but it's not as scalable and you will then need to maintain (e.g. purge/roll logs) on a set frequency.
Cheers,
Andrew
Created ‎03-11-2016 04:08 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Storing ranger audit logs on HDFS is beneficial for a couple of years:
A) It provides a more scalable distributed data store, so you can store logs for a lot longer
B) If you are currently leveraging Hadoop to store all security/audit logs. You can store your Ranger Audit logs along those in HDFS and be able to do better correlation between access request from different systems to help detect anomalies
Storing in the RBDMS was the original default. It provides better response times on smaller data sets but it's not as scalable and you will then need to maintain (e.g. purge/roll logs) on a set frequency.
Cheers,
Andrew
Created ‎03-11-2016 07:19 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks @Andrew Watson
@andrew watson
@Vperiasamy
Do we know which version of HDP saving ranger Audit to DB is going to be unsupported?
Created ‎03-11-2016 08:32 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Ranger support for DB will most probably be phased out in the next release, it is being discussed in the community currently.
