question Ranger Audit DB size? in Archives of Support Questions (Read Only)

Ranger Audit DB size?

sunile_manjee — Tue, 22 Nov 2016 04:57:28 GMT

What is a good recommendation on storage size for ranger audit on oracle. I want to store all hdfs, hbase, hive, and kafka audit created by ranger. I don't see anything on recommended db storage size. We are planning on using solr in the near future, but right now need db size info. any insights?

Re: Ranger Audit DB size?

sshimpi — Tue, 22 Nov 2016 13:27:25 GMT

@Sunile Manjee

I see from HDP 2.5 audit to db support is removed and Solr is the only option to used as Ranger audit. With respect to DB size recommendations i need to check.

Re: Ranger Audit DB size?

vperiasamy — Wed, 23 Nov 2016 02:22:32 GMT

Hbase generates large amount of audit logs, so consider that when storing them in audit DB.

Audit to DB support is removed from HDP 2.5, so you should consider Solr sooner rather than later.

Re: Ranger Audit DB size?

ed_gleeck — Thu, 01 Dec 2016 00:08:46 GMT

@Sunile Manjee

This would really depend on the cluster size and the number of jobs running. Very hard to gauge. A 10 node cluster with around 15-20 components can easily generate 1GB of audit logs PER DAY. Again depends on the cluster activity. You could use this as a baseline, but again, really hard to gauge.

Then again consider this only if being forced to use DB and after strongly advising against using DB as oppose to using Solr for ranger audits 🙂