- Subscribe to RSS Feed
- Mark Question as New
- Mark Question as Read
- Float this Question for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
hdfs audit and ranger hdfs audit
- Labels:
-
Apache Hadoop
-
Apache Ranger
Created ‎06-19-2018 01:22 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
Why we have 2 audit for one service? Since ranger audit stores in HDFS and native HDFS stores in local filesystem. We can keep it as backup? Or different information?
Created ‎06-19-2018 04:31 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Anpan K HDFS audit is different than Ranger audit. They are complementary. The benifit of using Ranger to check the audit is that everything is on centralized location, while hdfs audit you have to check on each node local disk.
HTH
*** If you found this answer addressed your question, please take a moment to login and click the "accept" link on the answer.
Created ‎06-19-2018 02:02 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@Anpan K Follow the following steps to disable hdfs audit:
https://community.hortonworks.com/questions/101082/disable-log4j-logging-for-hdfs-audit-log.html
Please remember to mark the answer.
Created ‎06-19-2018 04:52 AM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
HDFS audit is different from ranger hdfs audit. Ranger HDFS audit works only when "Ranger HDFS" plugin is enabled. In case you want audits when Ranger HDFS plugin is not enabled, then you use hdfs audits. If ranger hdfs plugin is enabled, then you use ranger hdfs audits.
Ranger audits are stored in HDFS and also can be stored in Solr. To put audits to Solr, enable "Audits to Solr" plugin from Ambari.
You can see the logs in Ranger UI if the audits are logged to Solr , it cannot read audits from HDFS.
.
-Aditya
Created ‎06-19-2018 12:52 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you, there is no option to Accept.
Created ‎06-19-2018 01:22 PM
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thank you and last question. I already have Ranger audit and I need to disable HDFS audtit. How can I disable HDFS audit?
