Archives of Support Questions (Read Only)

This is an archived board for historical reference. Information and links may no longer be available or relevant
Announcements
This board is archived and read-only for historical reference. To ask a new question, please post a new topic on the appropriate active board.

Zookeeper storage calculation

avatar
Master Guru

How is zookeeper storage sized/calculated?

  • For example If I have 100TB on hbase what is the storage requirements for zookeeper?
  • For example if I have 100TB index on solr what is the storage requirement for zookeeper?
1 ACCEPTED SOLUTION

avatar
Super Guru

In general, Zookeeper doesn't actually required huge drives because it will only store metadata information for many services, I have seen customer using 100G to 250G of partition size for zookeeper data directory and logs which is fine of many cluster deployment. Moreover administrator need to set configuration for automatic purging policy of snapshots and logs directories so that we don't end up by filling all the local storage.

Please refer below doc for more info.

http://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html

View solution in original post

1 REPLY 1

avatar
Super Guru

In general, Zookeeper doesn't actually required huge drives because it will only store metadata information for many services, I have seen customer using 100G to 250G of partition size for zookeeper data directory and logs which is fine of many cluster deployment. Moreover administrator need to set configuration for automatic purging policy of snapshots and logs directories so that we don't end up by filling all the local storage.

Please refer below doc for more info.

http://zookeeper.apache.org/doc/trunk/zookeeperAdmin.html