Support Questions

Find answers, ask questions, and share your expertise
Announcements
Celebrating as our community reaches 100,000 members! Thank you!

What are file system options for HBase deployment?

avatar
Contributor

I am aware that HDFS is the common filesystem for HBase deployments, but I would like to understand the other filesystem options and possible drawbacks.

1 ACCEPTED SOLUTION

avatar
Super Guru
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login
7 REPLIES 7

avatar

@Boris Demerov

Apart from HDFS. HBase users can also use the local filesystem by specifying the "hbase.rootdir" to point to the local filesystem in the "hbase-site.xml"

Example: http://hbase.apache.org/0.94/book/quickstart.html

<configuration>
  <property>
    <name>hbase.rootdir</name>
    <value>file:///home/someuser/hbase</value>
  </property>
  <property>
    <name>hbase.zookeeper.property.dataDir</name>
    <value>/home/someuser/zookeeper</value>
  </property>
</configuration>

.

avatar
Super Guru
hide-solution

This problem has been solved!

Want to get a detailed solution you have to login/registered on the community

Register/Login

avatar
Explorer

Thanks, @Constantin Stanca and @jss.

avatar
Super Guru

Beware that S3 presently does not support the level of "sync durability" that is required by HBase write-ahead log files. This means that there would likely be data loss if you tried to run HBase fully on S3.

avatar
Contributor

Thanks all! Appreciate the detail.

avatar
Guru

HBase in HDP is certified to run on top of HDFS, WASB/ADLS (using Azure HDInsight) and EMC Isilon.

avatar
Expert Contributor

I'd like to add a point of clarity for Dell EMC Isilon.

In Isilon's OneFS operating system we have implemented the server (NameNode, DataNode) half of HDFS. A solution with Isilon still requires client systems (eg, CentOS) that have the HDFS Client installed. HBase would be installed on those systems with the HDFS client.

HBase cannot be installed on OneFS and run in standalone mode. It could be installed in standalone mode on another system that used a mount or other path to store data on OneFS. But that would not be the same as running HBase on OneFS.