Support Questions

Find answers, ask questions, and share your expertise

Zookeeper storage calculation

avatar
Master Guru

How is zookeeper storage sized/calculated?

  • For example If I have 100TB on hbase what is the storage requirements for zookeeper?
  • For example if I have 100TB index on solr what is the storage requirement for zookeeper?
1 ACCEPTED SOLUTION

avatar
Super Guru

In general, Zookeeper doesn't actually required huge drives because it will only store metadata information for many services, I have seen customer using 100G to 250G of partition size for zookeeper data directory and logs which is fine of many cluster deployment. Moreover administrator need to set configuration for automatic purging policy of snapshots and logs directories so that we don't end up by filling all the local storage.

Please refer below doc for more info.

http://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html

View solution in original post

1 REPLY 1

avatar
Super Guru

In general, Zookeeper doesn't actually required huge drives because it will only store metadata information for many services, I have seen customer using 100G to 250G of partition size for zookeeper data directory and logs which is fine of many cluster deployment. Moreover administrator need to set configuration for automatic purging policy of snapshots and logs directories so that we don't end up by filling all the local storage.

Please refer below doc for more info.

http://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html