Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

Can't create table in Hbase because of: Can't get master address from ZooKeeper; znode data == null

Can't create table in Hbase because of: Can't get master address from ZooKeeper; znode data == null

Hello Everyone,

 

Thanks for the help! I currently have a CDH 5.3 using AWS Quickstart. I am trying to create a simple table in hbase, but I am getting this error: 

 

ERROR: Can't get master address from ZooKeeper; znode data == null *EDIT see 1) *

 

I googled this error and it seems like its a configuration issue. However, I am using Cloudera and I'm guessing hdfs should already have the correct zookeeper path.

 

1) For some reason the Master for Hbase is down and we can't bring it back up. 

 

EDIT: I restarted the cluster and this issue is taken care of. Now I am getting this error...I believe this might be a step backward? 

 

 org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet

 

2) I saw that it went down the first time we stopped our cluster...is there a proper way to shut down our cluster? We went into our cluster and did the stop command...waited till all the services shut down and then stopped our AWS instances.

 

Thanks for the help!

 

Best,

 

Su

4 REPLIES 4

Re: Can't create table in Hbase because of: Can't get master address from ZooKeeper; znode data ==

You can't create the table becasue there is no HMaster running. What
is the actual error in the HMaster logs?

The proper way to shut down the cluster is to click the small arrow
next to the cluster name and pick "stop". This will stop services in
the right order.

Regards,
Gautam Gopalakrishnan
Highlighted

Re: Can't create table in Hbase because of: Can't get master address from ZooKeeper; znode data ==

I can't get the HMaster Running. That is how I stopped the cluster. I only configured it with one Hmaster...could that be the reason?

 

Where could I find the HMaster logs?

 

Thanks!

Re: Can't create table in Hbase because of: Can't get master address from ZooKeeper; znode data ==

Having only one HMaster is not ideal but not invalid either. The logs
should be under /var/log/hbase on the host.

Regards,
Gautam Gopalakrishnan

Re: Can't create table in Hbase because of: Can't get master address from ZooKeeper; znode data ==

Here are the logs, thank you for the help!

 

2015-02-11 21:01:19,253 INFO org.apache.hadoop.hbase.util.FSUtils: Waiting for dfs to exit safe mode...
2015-02-11 21:01:29,263 INFO org.apache.hadoop.hbase.util.FSUtils: Waiting for dfs to exit safe mode...
2015-02-11 21:01:39,408 INFO org.apache.hadoop.hdfs.DFSClient: No node available for BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 file=/hbase/hbase.version
2015-02-11 21:01:39,410 INFO org.apache.hadoop.hdfs.DFSClient: Could not obtain BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 from any node: java.io.IOException: No live nodes contain current block No live nodes contain current block Block locations: Dead nodes: . Will get new block locations from namenode and retry...
2015-02-11 21:01:39,410 WARN org.apache.hadoop.hdfs.DFSClient: DFS chooseDataNode: got # 1 IOException, will wait for 265.84606873793484 msec.
2015-02-11 21:01:39,685 INFO org.apache.hadoop.hdfs.DFSClient: No node available for BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 file=/hbase/hbase.version
2015-02-11 21:01:39,685 INFO org.apache.hadoop.hdfs.DFSClient: Could not obtain BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 from any node: java.io.IOException: No live nodes contain current block No live nodes contain current block Block locations: Dead nodes: . Will get new block locations from namenode and retry...
2015-02-11 21:01:39,685 WARN org.apache.hadoop.hdfs.DFSClient: DFS chooseDataNode: got # 2 IOException, will wait for 6340.581198960086 msec.
2015-02-11 21:01:46,028 INFO org.apache.hadoop.hdfs.DFSClient: No node available for BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 file=/hbase/hbase.version
2015-02-11 21:01:46,028 INFO org.apache.hadoop.hdfs.DFSClient: Could not obtain BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 from any node: java.io.IOException: No live nodes contain current block No live nodes contain current block Block locations: Dead nodes: . Will get new block locations from namenode and retry...
2015-02-11 21:01:46,029 WARN org.apache.hadoop.hdfs.DFSClient: DFS chooseDataNode: got # 3 IOException, will wait for 13877.555700124 msec.
2015-02-11 21:01:59,909 WARN org.apache.hadoop.hdfs.DFSClient: Could not obtain block: BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 file=/hbase/hbase.version No live nodes contain current block Block locations: Dead nodes: . Throwing a BlockMissingException
2015-02-11 21:01:59,910 WARN org.apache.hadoop.hdfs.DFSClient: Could not obtain block: BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 file=/hbase/hbase.version No live nodes contain current block Block locations: Dead nodes: . Throwing a BlockMissingException
2015-02-11 21:01:59,911 WARN org.apache.hadoop.hdfs.DFSClient: DFS Read
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 file=/hbase/hbase.version
at org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:886)
at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:567)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:797)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:844)
at java.io.DataInputStream.read(DataInputStream.java:149)
at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:192)
at org.apache.hadoop.hbase.util.FSUtils.getVersion(FSUtils.java:497)
at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:581)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:462)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:153)
at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:129)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:808)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:613)
at java.lang.Thread.run(Thread.java:745)
2015-02-11 21:01:59,922 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled exception. Starting shutdown.
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block: BP-71274262-10.0.2.216-1422557273293:blk_1073741826_1002 file=/hbase/hbase.version
at org.apache.hadoop.hdfs.DFSInputStream.chooseDataNode(DFSInputStream.java:886)
at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:567)
at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:797)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:844)
at java.io.DataInputStream.read(DataInputStream.java:149)
at org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:192)
at org.apache.hadoop.hbase.util.FSUtils.getVersion(FSUtils.java:497)
at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:581)
at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:462)
at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:153)
at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:129)
at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:808)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:613)
at java.lang.Thread.run(Thread.java:745)
2015-02-11 21:01:59,923 INFO org.apache.hadoop.hbase.master.HMaster: Aborting
2015-02-11 21:01:59,924 INFO org.apache.hadoop.ipc.RpcServer: Stopping server on 60000
2015-02-11 21:01:59,924 INFO org.apache.hadoop.ipc.RpcServer: RpcServer.listener,port=60000: stopping
2015-02-11 21:01:59,928 INFO org.apache.hadoop.ipc.RpcServer: RpcServer.responder: stopped
2015-02-11 21:01:59,928 INFO org.apache.hadoop.ipc.RpcServer: RpcServer.responder: stopping
2015-02-11 21:01:59,930 INFO org.apache.hadoop.hbase.master.HMaster: Stopping infoServer
2015-02-11 21:01:59,939 INFO org.mortbay.log: Stopped HttpServer$SelectChannelConnectorWithSafeStartup@0.0.0.0:60010
2015-02-11 21:01:59,950 INFO org.apache.zookeeper.ZooKeeper: Session: 0x14b7adb66f10004 closed
2015-02-11 21:01:59,950 INFO org.apache.zookeeper.ClientCnxn: EventThread shut down
2015-02-11 21:01:59,950 INFO org.apache.hadoop.hbase.master.HMaster: HMaster main thread exiting
2015-02-11 21:01:59,951 ERROR org.apache.hadoop.hbase.master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: HMaster Aborted
at org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:194)
at org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:135)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:126)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2822)