question Re: Mysql or solr for ranger in Archives of Support Questions (Read Only)

Mysql or solr for ranger

arunpoy — Tue, 28 Mar 2017 12:56:30 GMT

Which one to use for ranger audits. Mysql or solr. I have a small lab cluster. Any thoughts

Re: Mysql or solr for ranger

jsensharma — Tue, 28 Mar 2017 13:07:33 GMT

The MySQL option is fine for small to medium clusters, given enough database horsepower behind it, however it's going to struggle on higher through puts. As your cluster gets larger and busier, you'd need to almost move the MySQL db to a dedicated machine etc.

The url you quoted is from early on in Ranger's history, there is now an Apache Solr backend for the Ranger audit db, which is significantly more scalable.https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/ch_install_solr.html

These days almost everyone start with the Solr backend as it's more scalable and will lead to fewer issues in the future as the cluster grows. Unless you have a very small environment, go Solr!

Re: Mysql or solr for ranger

arunpoy — Tue, 28 Mar 2017 13:43:45 GMT

@Jay SenSharma, IS it possible to just use HDFS alone as the back end for audits?

Re: Mysql or solr for ranger

jsensharma — Sun, 18 Aug 2019 09:55:27 GMT

@ARUN

Are you looking out for this:

1. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.0/bk_Ranger_Install_Guide/content/save_audits_to_hdfs.html

2. https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.2/bk_Ranger_Install_Guide/content/audit_to_solr.html

It is recommended that Ranger audits be written to both Solr and HDFS. Audits to Solr are primarily used to enable queries from the Ranger Admin UI. HDFS is a long-term destination for audits -- audits stored in HDFS can be exported to any SIEM system, or to another audit store.

Re: Mysql or solr for ranger

arunpoy — Tue, 28 Mar 2017 13:52:24 GMT

yes @Jay SenSharma, jsut want a confirmation whether i can store the audits only on hdfs alone. i dont want the solr option becasuee of resource constraints and the DB option is not available in the ambari. i am using hdp 2.5

Re: Mysql or solr for ranger

jsensharma — Tue, 28 Mar 2017 13:56:48 GMT

@ARUN

Please see the above screenshot showing how to use only "HDFS" option for audits.

Re: Mysql or solr for ranger

vperiasamy — Wed, 29 Mar 2017 00:59:52 GMT

Please note DB based auditing is NOT supported from Ranger 0.6 (HDP 2.5)