Support Questions
Find answers, ask questions, and share your expertise
Announcements
Alert: Welcome to the Unified Cloudera Community. Former HCC members be sure to read and learn how to activate your account here.

hbase hanging after cdh 5.3 upgrade

hbase hanging after cdh 5.3 upgrade

Explorer

Hi,

 

after upgrading the stack from 5.2.1 to cdh 5.3.0 hbase stopped working. for example when in the hbase shell trying to scan a table it just hangs until it timeouts. here is is a jstack of the hbase shell client: http://pastebin.com/dwfi7CwP

 

my hbase config is simply:

 

<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>hdfs://cluster/hbase</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>node00, node01, node02</value>
</property>
</configuration>

 

running two hbase masters...

 

any idea what's causing it and if there is a workaround?

 

thanks,

Antony.

5 REPLIES 5

Re: hbase hanging after cdh 5.3 upgrade

Explorer

better jstack here: http://pastebin.com/EUTFfmDC

Re: hbase hanging after cdh 5.3 upgrade

Explorer

fyi if I just downgrade hbase to cdh 5.2.1 while leaving the rest of the cluster (all hadoop, zookeeper etc) on cdh 5.3 it works as charm so it is something to do with hbase.

Re: hbase hanging after cdh 5.3 upgrade

Explorer

this is still the same issue even with hbase from cdh 5.3.1

Re: hbase hanging after cdh 5.3 upgrade

Rising Star

Are both HDFS and ZooKeeper running?

Are you able to do hdfs dfs command over HDFS?

Also please see if znodes for HBase exist in zookeeper shell; zookeeper-client --> ls /hbase

If you created the cluster using Cloudera Manager, make sure you did deploy client configuration.

Highlighted

Re: hbase hanging after cdh 5.3 upgrade

Explorer

yes, everything is running - whole cluster on cdh 5.3 and hbase is stuck. when downgrading _just_ hbase to cdh 5.2.1 (everything else stays inc config) it *works*. the problem occurs for all cdh 5.3 hbase releases.