Archives of Support Questions (Read Only)

sunile_manjee · ‎03-15-2016

How is zookeeper storage sized/calculated?

For example If I have 100TB on hbase what is the storage requirements for zookeeper?
For example if I have 100TB index on solr what is the storage requirement for zookeeper?

jyadav · ‎03-16-2016

In general, Zookeeper doesn't actually required huge drives because it will only store metadata information for many services, I have seen customer using 100G to 250G of partition size for zookeeper data directory and logs which is fine of many cluster deployment. Moreover administrator need to set configuration for automatic purging policy of snapshots and logs directories so that we don't end up by filling all the local storage.

Please refer below doc for more info.

http://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html

View solution in original post

jyadav · ‎03-16-2016

In general, Zookeeper doesn't actually required huge drives because it will only store metadata information for many services, I have seen customer using 100G to 250G of partition size for zookeeper data directory and logs which is fine of many cluster deployment. Moreover administrator need to set configuration for automatic purging policy of snapshots and logs directories so that we don't end up by filling all the local storage.

Please refer below doc for more info.

http://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html

Cloudera Community

Archives of Support Questions (Read Only)

Zookeeper storage calculation