Support Questions
Find answers, ask questions, and share your expertise

HBaseClientService: .MasterNotRunningException when trying to connect to HBase on a (kerberized) HDP 2.5 cluster

I get a org.apache.hadoop.hbase.MasterNotRunningException when trying to connect to HBase on a (kerberized) HDP 2.5 clusterAny pointers what might be the reason?

See img for a screenshot of the hbase config
Full error: 
HBase_1_1_2_ClientService[id=5f70fc31-0159-1000-2c53-4cc65573f4a1] Failed to invoke @OnEnabled method due to org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=1, exceptions:
Mon Jan 02 15:38:48 CET 2017, RpcRetryingCaller{globalStartTime=1483367927236, pause=100, retries=1}, org.apache.hadoop.hbase.MasterNotRunningException: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Call to failed on local exception: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Connection to is closing. Call id=0, waitTime=625

Settings for the HBaseClientService:



BTW: all HBase & related services are running all green according to Ambari.

Super Guru
@Ward Bekker

Have you provided "hbase-site.xml" in your Hadoop configuration files? If yes, check the value of host name for example under "hbase.rootdir".

Expert Contributor

@Ward Bekker

Looks like the hbase master is not up on the node . Can you check if the hbase master is up and running on the node? You can do below to check the hbase master process:

1. lsof -i:16000

2. netstat -anp | grep 16000 | grep LISTEN

If you do not see any process listening to on this port then bounce the hbase master process and see if the service comes up and you are able to pull up the hbase master UI and access it.

One common cause of the "ConnectionClosingException" that your client is seeing is HBase authorization. I'd recommend that you set the HBase log4j level to DEBUG, restart HBase, and then re-run this experiment.

On failure, look at the Master's log again and see if there is a clear explanation as to why the connection was rejected.